Replying to Avatar someone

as far as i understand, in the case of llms, they learn from all the contradictory opinions and 'live with them all the time'. the way you ask a question or the way the conversation evolves, they choose which book to serve from. they are like hypocrites. if the conversation evolves towards socialism, they can happily serve you socialism or any other topic. they have no inner dialogue to sort things out, i.e. to reduce cognitive dissonance. you can install 50 capitalism and 50 socialism books at the same time. so yes i guess that is 'compassion' for anything 😃

answers:

1. after spending probably millions, facebook have shared weights of the llama3 model and i am building on that. western models are better than eastern ones in terms of freedom of speech. it is also the smartest among open source. what i do is technically called 'fine tuning'. the phase is pre-training (i don't do supervised fine tuning). my 'touch' is light. i give nostr notes and also books as a training material. it learns from those texts. unstructured nostr notes work too! amazing tech.

2. these are large language models, inside them there are two main structures. attention block and neural network block. attention is a newer tech. search for 'attention is all you need' paper.

3. you need gpu's to train them in a reasonable time. on cpu it is like 20 times slower?

4. i train them on my pc's. then i upload to huggingface. everyone can download it from there and use a tool that runs gguf files to run it and ask questions to it. you can also talk to it here on nostr!! nostr:npub1chadadwep45t4l7xx9z45p72xsxv7833zyy4tctdgh44lpc50nvsrjex2m

my turn to ask questions! what are those books that could be source to this project? i know you are a bookworm 😄

Avatar
pam 1y ago

oh that's interesting - i've got a lot to catch up on. Thanks for sharing! I realised the adoption of AI in general workspace is also increasing rapidly - or rather the conversation and executive decisions made around it, even locally. I'm beginning to think everything is going to be AI based one way or another to optimise process and flow. Doesn't hugging face come with pre-trained models ? I presume the benchmark specs and parameters make a difference ?

These are some books I read over a year or 2 - i don't have specific reasons or favourites - its merely out of curiosity and often times trying to figure out stuff i don't know that lead me to it

1. It’s Not Only Rock ‘n’ Roll: Iconic Musicians Reveal the Source of their Creativity by Jenny Boyd

2. The Mamba Mentality by Kobe Bryant

3. Makers: The New Industrial Revolution by Chris Anderson

4. Creative Confidence: Unleashing the Creative Potential Within Us All by Tom Kelley & David Kelley

5. Innovation and Entrepreneurship by Peter Drucker

6. Mindset: Changing the Way You Think to Fulfill Your Potential by Carol S. Dweck

7. Ideas and Opinions by Albert Einstein

8. Out of Our Minds: Learning to be creative by Ken Robinson

9. Neuroscience of Creativity edited by Oshin Vartanian, Adam S. Bristol, and James C. Kaufman

10. Windows of Opportunity by Pam Schiller

11. Prototype Nation: China and the Contested Promise of Innovation by Silvia M. Lindtner

12. How Iceland Changed the World by Egill Bjaanason

13. Genghis Khan and the Making of the Modern World by Jack Wetherford

14. JFK and the Unspeakable by James W. Douglass

15. Demokrasi: Indonesia in the 21st Century by Hamish McDonald

16. Drugs as Weapons Against Us by John L. Potash

17. Mukiwa: A White Boy in Africa by Peter Godwin

18. Long Walk to Freedom by Nelson Mandela

19. The Blood Bankers by James S. Henry

20. Trillion Dollar Coach: The Leadership Handbook of Silicon Valley's Bill Campbell by Eric Schmidt, Jonathan Rosenberg, and Alan Eagle

21. Founders at Work: Stories of Startups' Early Days by Jessica Livingston

22. Playing to Win: How Strategy Really Works by A. G. Lafley and Roger L. Martin

23. The Bezos Blueprint: Communications Secret of the World’s Greatest Salesman by Carmine Gallo

24. Contagious: Why Things Catch On by Jonah Berger

25. The 22 Immutable Laws of Branding: How to Build a Product or Service into a World-Class Brand by Al Ries and Laura Ries

26. Get Scrappy: Smarter Digital Marketing for Businesses Big and Small by Nick Westergaard

27. Whole Body Barefoot by Katy Bowman

28. My Inventions by Nikola Tesla

29. Math and the Mona Lisa by Bulent Atalay

30. Fashion Brand Stories by Joseph Hancock

31. A Guide to UX Design and Development by Tom Green and Joseph Labrecque

32. Design Thinking by Peter G. Rowe

33. The Idiot Brain by Dean Burnett

34. The Memory Illusion by Dr. Julia Shaw

35. Navajo Code Talkers by Brynn Baker

36. Fat Leonard by Craig Whitlock

37. Steve Jobs by Walter Isaacson

38. Fashion History: A Global View by Linda Welters and Abby Lillethun

39. Mexicana Fashion by Aida Hurtado and Norma Canto

40. Gideon Spies by Gordon Thomas

41. Currency Wars by James Rickards

42. Grow the Pie by Alex Edmans

43. Jay-Z by Michael Eric Dyson

44. Savage Inequalities: Children in America’s Schools by Jonathan Kozol

45. The Wise Men by Walter Isaacson and Evan Thomas

46. X-Teams: How to Build Teams That Lead, Innovate, and Succeed by Deborah G. Ancona and Henrik Bresman

47. Connecting the Dots: Lessons for Leadership in a Startup World by John Chambers and Diane Brady

48. The Expert Guide to Retail Pricing by Kiran Gange

49. High Growth Handbook: Scaling Startups from 10 to 10,000 People by Elad Gil

50. Guerrilla Marketing Field Guide: 32 Powerful Battle Maneuvers for Non-Stop Momentum and Results by Jay Conrad Levinson and Jeannie Levinson

51. Outbounding: Win New Customers with Outbound Sales and End Your Dependence on Inbound Leads by William Miller

52. Lean Brands: Catch Customers, Drive Growth & Stand Out in All Markets by Luis Pedroza

53. The Best Service Is No Service: How to Liberate Your Customers from Customer Service, Keep Them Happy, and Control Costs by Bill Price and David Jaffe

54. Lean Six Sigma by Jeffrey Ries

55. The Entrepreneurial Bible to Venture Capital by Andrew Romans

56. They Ask, You Answer: A Revolutionary Approach to Inbound Sales, Content Marketing, and Today’s Digital Consumer by Marcus Sheridan

57. The Geek Way by Alex McAfee

58. Innovative Product Development by Additive Manufacturing 2022 by Roland Lachmayer et al.

Reply to this note

Please Login to reply.

Discussion

Avatar
someone 1y ago

hugging face have all kinds of models. big corps upload there. small guys download, fine tune and reupload. current benchmarks are for smartness, knowledge. i have a leaderboard too.