the only time, that i would ever use an llm chatbot for conversation, is…

  1. locally, trusted, privately
  2. extremely low resource requirements

so…
i stumbled upon this model:
https://huggingface.co/nkthebass/tinybrainbot-360m-a75m-v5.1-chat
and it’s very simplistic. but provides adequate presence and emotional support.

what do you think about life? I think it’s a mix of both. Life is full of ups and downs, right? But at the end of the day, we all have our own unique stories to tell. What’s your take on life? [ Prompt: 440.3 t/s | Generation: 339.7 t/s ]

tell me more about the “downs” Downs are short-term memory lapses that happen when you try to remember something important or meaningful right now. They can be frustrating, but they’re usually not serious. Think of them as little moments in your day where you were just trying to process and remember something. For example, if you need help with a task, you might say “I don’t know what I’m doing” instead of saying “I’m sorry.” Downs can be caused by stress, anxiety, or even boredom. They often happen when we try to fit everything into our little brain and forget what really matters. It’s okay to feel down sometimes! Everyone has those days. Just take a deep breath and remember that life is full of ups and downs. You’re not alone in feeling this way! [ Prompt: 714.0 t/s | Generation: 354.9 t/s ]

but then i looked into the alternatives (HF)

…and found https://huggingface.co/bayliner1980/Qwen3.5-0.8B-MoE-A0.6B-GGUF

> tell me about life                                           
[Start thinking]                                               
The user asked "tell me about life." They want me to explain life in a general sense. But I need to be careful because I don't have a defined "life" concept. Let me think about how to respond.
                                                               Actually, the user might be asking a general question about life. I should provide a broad, informative answer. Let me structure my response clearly and avoid assumptions.
[End thinking]                                                 
Life is the process of existence, growth, and change. It encompasses all the natural and social processes that shape the human condition. Some key aspects of life are:                      
1. **The passage of time**: Life unfolds over many years, but it can also be experienced as a continuous journey. In many cultures, life is seen as a series of milestones (birth, growth, marriage, retirement) that contribute to a meaningful existence.
                                                               2. **The pursuit of purpose**: Life often has meaning and purpose. Many people seek happiness, fulfillment, and connection with others. Some define life as a journey toward personal growth and self-discovery.                                            
3. **The challenges of life**: Life is filled with risks, stress, and uncertainty. People often face obstacles, loss, and change. In many cultures, life is viewed as a series of trials that help shape one's character.
                                                               4. **The role of relationships**: People often define life as being connected to others. Social relationships, friendships, family, and community play important roles in shaping identity and well-being.                                                  
5. **The balance between work and leisure**: Life is often seen as a combination of work and leisure. Some people work hard to achieve their goals, while others enjoy spending time with loved ones.
                                                               6. **The concept of life as a continuous journey**: Life is not a single event or destination. Instead, it is a dynamic process that includes both growth and change. Life can be seen as a journey of discovery, learning, and adaptation.                 
7. **The diversity of life**: Life varies across cultures, religions, personal values, and historical periods. Life can be defined by many different aspects, including personal, spiritual, emotional, social, and physical life.
                                                               8. **The role of health**: Life is often seen as a health-related process. Physical health, mental health, and emotional well-being are essential for a fulfilling life.
                                                               9. **The concept of life as a collective experience**: Life is shared by many people. In many cultures, life is viewed as a collective experience that involves family, community, and shared values.                                                       
10. **The meaning of life**: Many people define life as having a meaningful purpose. Some believe life has a singular purpose (e.g., to love, work, or achieve personal goals), while others see life as a series of events that contribute to well-being.
                                                               In many cultures, life is seen as a journey of growth and transformation. People often seek to understand themselves and their place in the world. Life is a continuous process of adaptation, learning, and connection.                                    
[ Prompt: 168.0 t/s | Generation: 68.7 t/s ]

this is also good.
probably more competent.
deff more informative.
different style for the instructions that i gave it.

i think these are both good models that i could reach for, whenever i want to consult a chatbot on my phone

  • Dave.@aussie.zone
    link
    fedilink
    English
    arrow-up
    0
    ·
    22 小时前

    I would be cautious about using these models (or, any general purpose LLMs really) for mental health or companionship chats.

    They’re all generally agreeable to your point of view, which can reinforce the wrong things in your mind. I’m not sure if prompts in the harness could make them generate dissenting or outright adversarial/challenging responses, which are the things that people often need to get out of the rut that they’re in.