Steve Grunwell :verified: on Nostr: I saw a demo today where, given a #PHP class and asked to write tests, GitHub ...

I saw a demo today where, given a #PHP class and asked to write tests, GitHub #CoPilot wrote a single unit test (with one assertion) to test a method that could return true or false, depending on the result of another method.

It stubbed the nested method to return the one value that could trigger a "true" return value. It did not test *any* other inputs (which would have produced false).

If you're only #testing the happy path, you're barely scratching the surface, no matter what "AI" thinks.