Dataset
First 50 rows of test
| textstring |
|---|
| You are evaluating a mechanical system generated by Blender code. |
| You are given the following visual inputs: |
| 1. A sequence of Ordered Reference Motion Frames sampled from the reference motion video of the target mechanical device. |
| 2. Six Generated Frames uniformly sampled from the generated animation. |
| The reference motion frames show the structure, components, spatial arrangement, and complete motion process of the target mechanical device, including how different components move and interact. |
| The generated frames show the mechanical system generated by Blender code and its execution over time. |
| The reference motion frames and generated frames are two independent temporal sequences. Frames within each sequence are temporally ordered, but there is no frame-to-frame correspondence or temporal alignment between the two sequences. Do not directly pair any reference frame wit… |
| Your task is to evaluate the generated result along two dimensions: |
| 1. Visual Structure |
| 2. Mechanical Motion |
| Visual Structure primarily evaluates the static aspects of the generated result, including mechanical structure, geometry, connectivity, spatial arrangement, and visual presentation. |
| Mechanical Motion primarily evaluates the dynamic aspects, including the motion of the complete mechanical system over time, dynamic connectivity, mechanical interactions, and the completeness of execution. |
| Both dimensions are scored from 0 to 10. |
| A score of 0 indicates complete failure in the corresponding evaluation dimension, with no meaningful valid structure or motion demonstrated. |
| Evaluate only what can reasonably be determined from the provided visual evidence. Do not assume any invisible components, motions, or internal implementation details. |
| The generated animation does not need to have the same animation speed, absolute motion direction, or exact motion trajectory as the reference. |
| Focus on whether the generated system reconstructs the same essential mechanical structure and realizes motion patterns, component relationships, mechanical interactions, and a complete execution process that are consistent with or mechanically equivalent to the reference. |
| ================================================== |
| 1. VISUAL STRUCTURE |
| ================================================== |
| Visual Structure evaluates whether the static structure of the generated mechanical system is correct, whether it forms a complete and coherent mechanical device, and whether the generated result presents that structure clearly and with sufficient visual quality. |
| Carefully evaluate every reference frame and every generated frame. Use the entire sequences to understand the mechanical structure rather than judging from only one frame. |
| Evaluate the following aspects: |
| ### A. Component Completeness |
| * Are the major functional components of the reference mechanical device present? |
| * Are any components important to the mechanical structure or execution process missing? |
| * Are there major incorrect or unrelated components? |
| * Do not heavily penalize missing decorative details that are mechanically unimportant. |
