do you know the feeling when a test succeeds when run alone but it fails when run in the pipeline

Reply to this note

Please Login to reply.

Discussion

No. But from the vibe of your note I'm guessing I don't even want to.πŸ˜€

Yes but it was because I wasn't clearing in memory mock DB πŸ™ƒ

Its that sinking hmmmm

This could be nothing (clear caches etc) or a terrible afternoon ahead (?????)

Yes. Sounds like muddied states for tests?

Yup, sounds like

all too well

multi-threading, failure to cleanup mock data(base), assumptions based on prior test state. Seen it all :(

I'm getting the feeling it's the DB sticking around

Yes. Or when it runs locally fine and you run it in the pipeline and it fails without any reason. Hated that and to this day i have not figured out why it failed.

Do you know the feeling of call the skip method on the test function?

Lol yes

I've had stubborm tests that just could not be fixed no matter what I did. CI can be hell sometimes

It is something like when you reach 95% at progress bar and,while you are realizing it is almost complete, it suddenly stuck at 97% forever .. so you have to stop everything and start to realize that something odd have to be overcome and understood ..

For us, it's often how slow the CI is. cpuset can be used to reproduce this...

It’s always how slow CI is, but somehow when I run it on an RPi it still never fails. I struggle to understand where GitHub gets machines as slow as Actions runners, but I guess we get what we pay for.