Running Mistral 7B on my Mac I’m getting 2mins - 3 mins latency for summarization tasks I have the front end in type script and back end in python. #AISTR #Tinkering

Reply to this note

Please Login to reply.

Discussion

No replies yet.