Heimdl and Veria

Veria closes out security concerns, Heimdl checks a test would catch one coming back

Two different questions

Veria asks

“Does this change look right?”

Heimdl asks

“If this change were wrong, would a test fail?”

Across the 1 pull request Veria reviewed, the tests missed 87% of the changes

Veria, #8160“No open security concerns remain on this pull request.”
infisical/infisical #8160HighAuthenticationLDAP auth check can be switched off, tests stay green71changes9caught11survived51uncovered1tests suggestedidentity-auth-template-service.ts:521survived- fieldPatch && template.authMethod === IdentityAuthTemplateMethod.LDAP+ falseSuggested test, LDAP URL change without bindPass throws when fieldPatch is presentawait expect(patchTemplate(service, { url: 'ldap://new.example.com' })).rejects.toThrow( "Changing an LDAP auth template's URL requires supplying bindPass. ..." );

Running both

Keep Veria for review, add Heimdl for proof your tests hold the change

Get a free auditAll case studies
Other comparisons
CodeRabbitGreptilecubicDevinCodexGitHub Copilot

Missed, the share of changes on the pull requests a reviewer reviewed that no test caught, survived plus uncovered

From Heimdl’s published audits of public pull requests, a reviewer is listed where it commented on the pull request