Context/Background

The system consists of hardware boards that enhance simple webcams with image recognition capabilities. These boards contain proprietary advanced image recognition algorithms embedded in their firmware. The boards are used in applications such as license-plate recognition systems in public parking facilities. A test and verification system is used to validate firmware updates prior to release. The quality requirement pertains to the performance of this firmware test and verification system.

Source

An update of the firmware is available, typically including additional functionality or improved recognition performance.

Metric/Acceptance Criteria

• The test and verification system must process 1000 real-hours of video and image playback in less than 72 hours

• This translates to a minimum playback speed of 14 times real-time (1000 hours / 72 hours ≈ 14)

• Specific criteria include:
  • Consistent maintenance of at least 14x playback speed throughout the entire test process (or less if tests are performed in parallel)
  • Accurate data transmission to the device-under-test at this accelerated rate
  • No loss of video frames or degradation of image quality during accelerated playback
  • Verification that the updated firmware recognizes images with at least the accuracy of previous versions
  • Complete processing of all 1000 hours of test data within the 72-hour timeframe
  • Accurate logging and reporting of test results, including any anomalies or performance issues detected