Skip to content
@nebuly-ai

Nebuly

User analytics for LLMs

What is NebulyAI?

At Nebuly, we view Large Language Models (LLMs) not merely as a new computing platform but as a transformative user experience revolution. As LLMs transition from proof of concept (PoC) to production, it’s essential for companies to ensure they provide real value to users.

This is where Nebuly comes in. We empower product and AI teams to comprehend and enhance the user experience of LLM-based products. By analyzing user behavior and interactions with LLMs, we create detailed user profiles to identify what works well and what needs improvement, ensuring an optimal experience for the end user.

Useful links

Community projects

We have open-sourced a couple of internal projects to the community, but we are not currently maintaining them:

  • Nos: If you have limited GPU resources and want to maximize GPU utilization for your LLMs, this module is designed to help you achieve that.
  • Optimate: If you’re looking to optimize the latency and cost of your LLMs, this library allows you to automatically apply multiple optimization techniques.

Popular repositories Loading

  1. optimate optimate Public

    A collection of libraries to optimise AI model performances

    Python 8.4k 636

  2. nos nos Public

    Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elastic quotas - Effortless optimization at its finest!

    Go 664 36

  3. exploring-AI-optimization exploring-AI-optimization Public

    Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀

    116 12

  4. k8s-device-plugin k8s-device-plugin Public

    Forked from NVIDIA/k8s-device-plugin

    NVIDIA device plugin for Kubernetes

    Go 48 8

  5. learning-hub learning-hub Public

    Jupyter Notebook 29 4

  6. nebuly-ai nebuly-ai Public

    17

Repositories

Showing 10 of 16 repositories

Top languages

Loading…

Most used topics

Loading…