Consultant's Volume Test Report

Dominion Democracy Suite 5.19 Voting System Volume Test Report for California Secretary of State CAF-23007-VTR-01 Vendor Name Dominion Vendor System Democracy Suite 5.19 Prepared by: SLI ComplianceSM 4720 Independence St. Wheat Ridge, CO 80033 303-422-1566 www.SLICompliance.com Accredited by the Election Assistance Commission (EAC) for VSTL status. California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 Copyright © 2025 by SLI ComplianceSM, a Division of Gaming Laboratories International, LLC Revision History Date Release Author Revisions July 5, 2024 1.0 M. Santos Initial Release Disclaimer The Certification Test results reported herein must not be used by the client to claim product certification, approval, or endorsement by NVLAP, NIST, or any agency of the Federal Government. Results herein relate only to the items tested. Trademarks • SLI is a registered trademark of SLI Compliance, a Division of Gaming Laboratories International, LLC. • All other products and company names are used for identification purposes only and may be trademarks of their respective owners. The tests referenced in this document were performed in a controlled environment using specific systems and data sets; results are related to the specific items tested. Actual results in other environments may vary. Opinions and Interpretations There are no SLI opinions or interpretations included in this report. California Certification Volume Test Report v1.0 Page 2 of 9 Report Number CAF-23007-VTR-01 California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 TABLE OF CONTENTS INTRODUCTION ................................................................................................................................... 4 REFERENCES....................................................................................................................................... 4 SYSTEM OVERVIEW ........................................................................................................................... 4 VOTING SYSTEM SCOPE ....................................................................................................................... 4 ImageCast Evolution (ICE) ............................................................................................................ 4 ImageCast X (ICX) Classic (SID-15V/SID-21V) and Prime (HID-21V) ......................................... 4 ImageCast Precinct (ICP2) ............................................................................................................ 5 CERTIFICATION TEST RESULTS SUMMARY ................................................................................... 5 VOLUME TESTING SUMMARY ................................................................................................................ 5 VOLUME TEST ..................................................................................................................................... 5 ImageCast Precinct (ICP2) Testing ............................................................................................... 6 ICX Classic Testing ........................................................................................................................ 6 ICX Prime Testing .......................................................................................................................... 7 ImageCast Evolution (ICE) Testing ............................................................................................... 7 Issues ............................................................................................................................................. 9 EVALUATION OF TESTING ..................................................................................................................... 9 California Certification Volume Test Report v1.0 Page 3 of 9 Report Number CAF-23007-VTR-01 California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 Introduction SLI Compliance is submitting this test report as a summary of the certification testing efforts for the Dominion Democracy Suite 5.19 (Dominion DS 5.19) voting system. The purpose of this document is to provide an overview of the certification testing effort and the findings of the testing effort for the Dominion DS 5.19 voting system. This effort included volume testing of the Dominion DS 5.19 voting system’s ImageCast® Evolution (ICE), ImageCast X (ICX) Classic BMD, ImageCast X (ICX) Prime BMD, and ImageCast Precinct (ICP2) components. References California Voting System Standards (CVSS) System Overview Voting System Scope This section provides a description of the Dominion DS 5.19 voting system components: • ImageCast® Evolution (ICE) • ImageCast X (ICX) Classic BMD • ImageCast X (ICX) Prime BMD • ImageCast Precinct (ICP2) ImageCast Evolution (ICE) The ICE device is a precinct-level optical scan device designed to perform three major functions: accessible voting and ballot marking ballot review and second chance voting, and ballot scanning and tabulation. The ICE is used in conjunction with ImageCast compatible ballot storage boxes. The system is designed to scan marked paper ballots printed on standard or secure paper stock, interpret voter marks on the paper ballot, and safely store and tabulate each vote from each paper ballot. The ICE also supports enhanced accessibility voting through optional accessories connected to the ImageCast unit. ImageCast X (ICX) Classic (SID-15V/SID-21V) and Prime (HID-21V) The ImageCast X (ICX) consists exclusively of commercial off-the-shelf (COTS) available hardware and operating system, while the applications installed on top customize its behavior to turn it into a Ballot Marking Device (BMD). The ICX California Certification Volume Test Report v1.0 Page 4 of 9 Report Number CAF-23007-VTR-01 California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 verifies voter’s session eligibility, using the smart card, and then presents the appropriate ballot to the voter. When a voter is satisfied with the choices selected, the ICX application verifies them and produces a marked printed ballot. The ICX is designed to perform the following functions: • Marking and printing of ballots (in BMD mode) • Ballot review and second chance voting • Accessible voting and ballot marking ImageCast Precinct (ICP2) The ImageCast Precinct (ICP2) device is a precinct-based optical scan ballot counter designed to provide two major functionalities: ballot scanning and tabulation, and ballot review and second chance voting. The ICP2 is used in conjunction with ImageCast compatible ballot storage boxes. The system is designed to scan marked paper ballots printed on standard or secure paper stock, interpret voter marks on the paper ballot, and safely store and tabulate each vote from each paper ballot. Certification Test Results Summary Volume Testing Summary A Volume Test was completed on the Dominion DS 5.19 voting system. Volume Test An election was run utilizing the following devices: • 20 ImageCast® Evolution (ICE) • 10 ImageCast X (ICX) Classic BMD • 10 ImageCast X (ICX) Prime BMD • 20 ImageCast Precinct (ICP2) The election definition was the same general election used in functional testing. • One deck of 500+ single sheet paper ballots were scanned on each ICP2 device twice, for a total of 1,000+ ballots per device. • 50 blank ballots were marked and printed on each ICX Classic and ICX Prime device. • One deck of 500+ single sheet paper ballots were scanned on each ICE device once. Another 500+ single sheet paper ballots were rescanned again on most of the devices. California Certification Volume Test Report v1.0 Page 5 of 9 Report Number CAF-23007-VTR-01 California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 • 50 blank ballots were marked and scanned on each ICE device for accessibility voting. • Dominion supplied sufficient test decks of ballots, pre-marked in a pattern approved by the California Secretary of State. • Additional blank ballots were provided to replace any ballots that were damaged during testing. • Sufficient quantities of blank ballots or ballot paper were supplied to mark using the ICX Classic and ICX Prime devices. ImageCast Precinct (ICP2) Testing The following steps for testing ICP2 devices were completed with results as noted: 1. Polls were opened for the ICP2 devices in accordance with California Use Procedures. Devices were brought to a state where ballots could be tabulated. o Zero Reports were printed. 2. For each ICP2 device, two decks of 500+ paper ballots were scanned. o Fifteen ICP2 devices experienced errors related to ballot jams. The ballot jams were caused when write-in ballots were diverted to the secondary ballot compartment. The ballot would entangle in the secondary compartment bag, resulting the jam. Manually expanding the secondary compartment bag or removing the bag entirely resolved the issue. 3. After the first deck of 500+ paper ballots were scanned and tabulated, the ballot box was opened, and the paper ballots were removed from the ballot bin to be scanned again. The totals displayed on screen were then compared to the expected results. o The total displayed results matched the expected results. 4. The polls were closed, and a Results Report was printed and compared with the expected results. o The printed results matched the expected results. 5. The polls were re-opened. 6. The first deck of 500+ paper ballots were then scanned again. 7. After the deck of 500+ paper ballots were cast a second time, the ballot box was opened, and the paper ballots were removed from the ballot bin. 8. The polls were closed. 9. The ICP2 devices were shut down. ICX Classic Testing California Certification Volume Test Report v1.0 Page 6 of 9 Report Number CAF-23007-VTR-01 California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 The following steps for testing the ICX Classic devices were completed with results as noted: 1. Polls were opened for the ICX Classic devices in accordance with California Use Procedures. o Devices were brought to a state where ballots could be marked and printed. 2. One ICX Classic was plugged into a UPS device. The UPS was removed from AC power for two hours, to test the backup battery. o The ICX device ran for two hours. 3. Once the time expired, the ICX Classic device was reconnected to AC power. 4. For each ICX Classic device, 50 ballots were marked and printed. 5. All devices printed their cards in the expected manner. ICX Prime Testing The following steps for testing the ICX Prime devices were completed with results as noted: 1. Polls were opened for the ICX Prime devices in accordance with California Use Procedures. o Devices were brought to a state where ballots could be marked and printed. 2. One ICX Prime was plugged into a UPS device. The UPS was removed from AC power for two hours, to test the backup battery. o The ICX device ran for two hours. 3. Once the time expired, the ICX Prime device was reconnected to AC power. 4. For each ICX Prime device, 50 ballots were marked and printed. 5. All devices printed their cards in the expected manner. ImageCast Evolution (ICE) Testing The following steps for testing ICE devices were completed with results as noted: 1. Polls were opened for the ICE devices in accordance with California Use Procedures. Devices were brought to a state where ballots could be tabulated. o Zero Reports were printed. 2. One ICE device was plugged into a UPS device. The UPS was removed from AC power for two hours, to test the backup battery. o The ICE device ran for two hours. California Certification Volume Test Report v1.0 Page 7 of 9 Report Number CAF-23007-VTR-01 California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 3. Once the time expired, the ICE device was reconnected to AC power. 4. For each ICE device, one deck of 500+ paper ballots were scanned and tabulated. 5. After the first deck of 500+ paper ballots were scanned and tabulated, the totals displayed on screen were compared to the expected results. 6. The total displayed results matched the expected results. 7. The polls were closed, and a Results Report was printed and compared with the expected results. o The printed results matched the expected results. 8. Polls were re-opened for the ICE devices in accordance with California Use Procedures. Devices were brought to a state where ballots could be tabulated. 9. For each ICE device, one deck of 50 paper ballots were marked and cast using an Accessibility Voting Session. o Six ICE devices experienced errors related to marking the ballot, displaying the message, 'Marking of the ballot was interrupted due to the error condition (error marking ballot).' When users selected the 'Yes' option, the ballot was rejected. A new ballot was then inserted to be marked and cast. If the ballot marking device detects a misalignment, it will not mark the ballot and will return it with this error message. o One ICE device experienced an error related to the marking of the ballot, where one mark was placed outside the intended oval. The ballot was subsequently rejected, and a new one was inserted to be marked and cast. Per Dominion, the scanner properly rejected the ballot as the system operated correctly. An obstruction in the device's inkjet printer caused one mark to be misplaced. The device automatically recalibrated itself, which is why the remainder of the ballot was correctly aligned except for the single erroneous mark. The system compares the printed ballot to the voter's on-screen selections, detects any discrepancies, and rejects the ballot if an error is found. After the deck of 50 paper ballots were marked and cast, the ballot box was opened, and the paper ballots were removed from the ballot bin to be scanned again. The totals displayed on screen were then compared to the expected results. 10. The total displayed results matched the expected results. 11. The polls were closed and then the polls were re-opened for the ICE devices in accordance with California Use Procedures. Devices were brought to a state where ballots could be tabulated. 12. The 550+ paper ballots removed from the ballot box were then scanned a second time. California Certification Volume Test Report v1.0 Page 8 of 9 Report Number CAF-23007-VTR-01 California Secretary of State Dominion Democracy Suite 5.19 California Certification Volume Test Report v1.0 13. After the deck of 550+ paper ballots were cast again, and the polls were closed. 14. The ICE devices were shut down. Issues The following issues were identified during testing: • Fifteen ICP2 devices experienced errors related to ballot jams. The ballot jams were caused when write-in ballots were diverted to the diverter ballot bag. The ballot would get caught up on the diverter ballot bag, causing the jam. Manually expanding the diverter ballot bag or removing the bag entirely seemed to resolve the issue. • • Six ICE devices experienced errors related to marking the ballot, 'Marking of the ballot was interrupted due to the error condition (error marking ballot).' When users selected the 'Yes' option, the ballot was rejected. A new ballot was then inserted to be marked and cast. If the ballot marking device detects a misalignment, it will not mark the ballot and will return it with this error message. One ICE device experienced an error related to the marking of the ballot, where one mark was placed outside the intended oval. The ballot was subsequently rejected, and a new one was inserted to be marked and cast. Per Dominion, the scanner properly rejected the ballot as the system operated correctly. An obstruction in the device's inkjet printer caused one mark to be misplaced. The device automatically recalibrated itself, which is why the remainder of the ballot was correctly aligned except for the single erroneous mark. The system compares the printed ballot to the voter's on- screen selections, detects any discrepancies, and rejects the ballot if an error is found. Evaluation of Testing The above testing was conducted using the executables created in the Trusted Build, in association with the appropriate hardware versions as declared during the certification project for the Dominion DS 5.19 voting system. As directed by the California Secretary of State, this volume testing report does not include any recommendation as to whether or not the system should be approved. End of Volume Test Report California Certification Volume Test Report v1.0 Page 9 of 9 Report Number CAF-23007-VTR-01