OVSTA
Los Angeles County Vsap 4.0 Consultant’s Volume Test Report
VSAP Tally Version 4.0
Read the report at Los Angeles County VSAP ↗
County of Los Angeles
Voting Solutions for All People (VSAP) 4.0
Volume and Reliability Test Report
for
California Secretary of State
CAF-25011-VRTR-01
Vendor Name County of Los Angeles
Vendor System VSAP 4.0
Prepared by:
4720 Independence St.
Wheat Ridge, CO 80033
303-422-1566
www.SLICompliance.com
Los Angeles County
VSAP 4.0
California Certification
Volume and Reliability Test Report v1.0
Revision History
Date Release Author Revision Summary
January 15th, 2026 1.0 E. Bickley Initial Release
Disclaimer
The information reported herein must not be used by the client to claim product
certification, approval, or endorsement by NVLAP, NIST, or any agency of the Federal
Government.
Trademarks
• SLI Compliance is a registered trademark of Gaming Laboratories International,
LLC.
• All products and company names are used for identification purposes only and may
be trademarks of their respective owners.
Copyright 2026 by SLI ComplianceSM, a division of Gaming Laboratories International, LLC.
California Certification Volume and Reliability Test Report Page 2 of 8
Report No. CAF-25011-VRTR-01
Los Angeles County
VSAP 4.0
California Certification
Volume and Reliability Test Report v1.0
TABLE OF CONTENTS
INTRODUCTION ................................................................................................................................. 4
TESTING RESPONSIBILITIES ................................................................................................................ 4
EQUIPMENT TESTED ........................................................................................................................... 5
TEST PREPARATIONS ......................................................................................................................... 5
TEST ACTIVITIES............................................................................................................................... 6
TEST SCHEDULES .............................................................................................................................. 6
EVALUATION OF TESTING .............................................................................................................. 8
California Certification Volume and Reliability Test Report Page 3 of 8
Report No. CAF-25011-VRTR-01
Los Angeles County
VSAP 4.0
California Certification
Volume and Reliability Test Report v1.0
INTRODUCTION
This Volume and Reliability Test Report details the work performed for the Volume
and Reliability testing on the County of Los Angeles’s Voting Solutions for All
People 4.0 (VSAP 4.0) voting system against the California Voting System
Standards (CVSS).
The purpose of this test was to verify that voting equipment will operate reliably in
conditions approximating normal use by voters in a polling place on Election Day.
Testing Responsibilities
All testing was conducted under the guidance of personnel verified by California
Secretary of State (CASOS) to be qualified to perform the testing.
Responsibility Assignments
CASOS utilized third party testers during the performance of portions of the
examination. Temporary contract personnel were utilized in the Volume testing. All
testing was witnessed or executed by CASOS personnel, with assistance from SLI
Compliance personnel.
Staffing
CASOS:
• Rodney Rodriguez
• Debra Ledsinger
• Jason Ando
• Temporary employees to vote test ballots
SLI:
• Evelyn Bickley
• Steve Ramage
Location
The test was conducted in Los Angeles, California, at the VSAP Operations
Center, 12100 Rivera Road, Whittier, California. Los Angeles County was
responsible for security of the site and equipment throughout the duration of the
test.
Schedule
Testing was conducted January 5–7, 2026. Los Angeles County delivered and set
up the equipment on January 4, 2026.
California Certification Volume and Reliability Test Report Page 4 of 8
Report No. CAF-25011-VRTR-01
Los Angeles County
VSAP 4.0
California Certification
Volume and Reliability Test Report v1.0
Facility:
Unless otherwise specified herein, examination and review were performed at the
following standard ambient conditions and tolerances:
• Temperature: 68–75° F (±3.6°F)
• Relative Humidity: Local Site Humidity
• Atmospheric Pressure: Local Site Pressure
• Time Allowable Tolerance: ±5%
Equipment Tested
The equipment used included:
• 50 Ballot Marking Devices (BMDs)
• 1 Ballot Marking Device Manager (BMG) for logging data
Ballot Marking Device
The BMD is the primary touchpoint for the voter and hub of the voting system,
guiding users with screen prompts and symbols. The BMD features a touchscreen,
an audio-tactile interface (controller and headphones), paper handler (scanner and
printer), QR code scanner, and dual-switch input which voters use to generate,
verify, and cast paper ballots. Completed ballots are transferred to the integrated
ballot box, which can be detached for unloading.
Test Preparations
The election definition utilized was the same 2024 Presidential Primary Election
used for the VSAP 4.0 Functional Test.
One hundred ballots were marked, printed, and cast on each BMD.
Each device was prepared as follows:
• Each device was assigned a unique test number.
• A label with the unique number was placed on the front of the device.
• Beginning with “1,” the numbers progressed sequentially and were at least
three inches high.
An inventory of all devices was taken. The inventory included:
• The type of device
• Device serial number
• Hardware version
• Software and/or firmware versions
• The test number assigned to the machine
California Certification Volume and Reliability Test Report Page 5 of 8
Report No. CAF-25011-VRTR-01
Los Angeles County
VSAP 4.0
California Certification
Volume and Reliability Test Report v1.0
• A column to record the number of ballots processed on the machine during
the test
The machines were arranged to allow sufficient space around the machines to
provide operators with space to stack un-voted ballots, as well as personal space.
TEST ACTIVITIES
All testing was accomplished in three phases:
• Environment setup
• Logging of devices, hashing of devices, and election loading
• Voting of ballots on BMDs
On Monday, January 5, 2026, with Los Angeles County representatives present,
CASOS and SLI Compliance representatives inventoried all devices as listed in the
“Equipment Tested” section above.
All devices were verified to have the correct firmware by checking hash codes of
the installed firmware against the hash codes of record for the validated firmware.
The election to be utilized was deployed to each device, and zero reports were run.
Temporary employees were utilized to perform the testing.
Temporary employees processed 100 ballots through each BMD. As temporary
employees finished their ballot marking, they were transferred to new devices. All
BMDs were exercised with 100 ballots being processed through each over the
three-day schedule for Volume testing. A total of 5,000 ballots were voted during
testing.
Test Schedules
All testing was accomplished according to the schedule provided in the Tables
below.
Table 1 – VSAP 4.0 Preparation Activities
Task
Task
#
1 All machines were delivered to testing site.
Setup machines. LA County was responsible for security of the venue during
2
testing.
3 Testing team kickoff meeting. Reviewed the test plan and rules.
Verified the machines. Checked machines to make sure no damage occurred in
5
transit. Devices were delivered with VSAP 4.0 Trusted Build already installed.
6 Each machine was labeled with test number.
California Certification Volume and Reliability Test Report Page 6 of 8
Report No. CAF-25011-VRTR-01
Los Angeles County
VSAP 4.0
California Certification
Volume and Reliability Test Report v1.0
Task
Task
#
Each machine was validated against Trusted Build HASHes to be running
7
Trusted Build VSAP 4.0.
8 A log of machine serial numbers information was captured.
9 Photograph each machine being tested with its serial number and test number.
10 Blank ballots were distributed for each machine.
Table 2 – VSAP 4.0 Ballot Marking and Reading Testing Activities
Task
Task
#
1 Checked-in temporary employees.
Briefed temporary employees on the test objectives for the day, their roles and
2 responsibilities, and provided them with the instructions a voter would be given
on how to mark ballots using a BMD.
The voters were instructed to signal any unexpected condition on a machine by
3
stepping back from the machine and raising their hand.
A CASOS representative documented any errors on the error form and entered it
4
in the error log
SLI staff interviewed the voter, analyzed the event, took any steps necessary to
5
continue marking ballots, and completed an incident report.
Incidents were categorized either as one of the substantive failures described in
6 the Protocol or as a non-substantive failure such as voter error or a defective
ballot.
7 Opened polls on machines as needed.
8 Voters marked 100 ballots on each BMD.
Any unexpected results were resolved and then documented and categorized as
9
either ballot defect or testing error.
10 Closed polls on machines as voting was completed.
11 Repeated this process for all machines.
12 Secured and retained all media and artifacts.
All media from all devices and all boxed ballots were brought to CASOS. Chain
13
of custody for ballots and media was maintained by CASOS.
The logs from each ballot marking device were loaded into BMG and the logs
14
were provided to CASOS.
California Certification Volume and Reliability Test Report Page 7 of 8
Report No. CAF-25011-VRTR-01
Los Angeles County
VSAP 4.0
California Certification
Volume and Reliability Test Report v1.0
EVALUATION OF TESTING
The following were noted during the Volume Test, and each was subsequently
mitigated:
1. Timing Feeds (Ballot not read) – During testing, out of the 50 BMDs used
and 5,000 ballots processed, there were eight instances where testers
experienced timid feeds or Ballot Page Metadata (BPM) errors which
required the ballot to be re-fed into the device.
On units #8 and #9 there were two instances of voters on these devices
having to re-insert the ballot multiple times before being accepted for each
voting session.
Units #16 and #17 reported one instance each of having to reinsert the
ballots.
The BMD device, by design, gently pulls the ballot into the device in a timid,
push/pull manner.
Testers would sometimes be too gentle in triggering the rollers, not allowing
the ballot to catch.
Testers would sometimes attempt to force feed the ballot.
At other times, testers would pull the ballot back after the device began to
gently pull the ballot into the device.
When a tester would perform one of these three actions, the BMD would
appear to pull the ballot in but immediately eject it and indicate to the voter
the ballot would need to be re-inserted.
2. Paper Jam – Two devices experienced a paper jam during testing. Each
device experienced only a single paper jam during testing as follows:
• Unit #3 experienced a paper jam during the initial insertion of a blank
ballot to begin the voting session. When removed from the scanner, the
ballot was undamaged with no noticeable markings or bends. It was re-
cast without further issues.
• Unit #30 experienced a paper jam during the casting of the ballot. When
removed from the scanner, the ballot was undamaged with no noticeable
marking or bends. It was re-cast without further issues.
As directed by the California Secretary of State, this report does not include any
recommendation as to whether or not the system should be approved.
End of Volume and Reliability Test Report
California Certification Volume and Reliability Test Report Page 8 of 8
Report No. CAF-25011-VRTR-01