Skip to content

Generative AI Resources ​

Resource Source ​

Repository: https://github.com/filipecalegario/awesome-generative-ai

Introduction: This is a carefully curated list of generative AI resources, covering various aspects of generative AI including models, tools, applications, tutorials, etc., helping you comprehensively understand and use generative AI technology.

Generative AI Overview ​

What is Generative AI? ​

Generative AI refers to AI systems capable of creating new content, including:

  • Text generation (e.g., GPT, Claude)
  • Image generation (e.g., DALL-E, Midjourney)
  • Audio generation (e.g., Whisper, AudioLM)
  • Video generation (e.g., Sora, Runway)
  • Code generation (e.g., Codex, StarCoder)

Core Technologies of Generative AI ​

  1. Large Language Models (LLM)

    • GPT series (GPT-3, GPT-4)
    • Claude series
    • LLaMA series
    • Other open-source models
  2. Diffusion Models

    • Stable Diffusion
    • DALL-E
    • Midjourney
    • Other image generation models
  3. Multimodal Models

    • GPT-4V
    • Claude 3
    • Gemini
    • Other multimodal models

Main Models ​

Text Generation Models ​

Closed-Source Models

GPT Series

  • GPT-3.5
  • GPT-4
  • GPT-4 Turbo
  • Features: Powerful text generation capabilities
  • Applications: Dialogue, writing, programming, etc.

Claude Series

  • Claude 2
  • Claude 3
  • Features: Long text support, safe and reliable
  • Applications: Long document analysis, dialogue, etc.

Other Closed-Source Models

  • Gemini (Google)
  • PaLM (Google)
  • Other commercial models

Open-Source Models

LLaMA Series

  • LLaMA 2
  • LLaMA 3
  • Features: Powerful performance, can be deployed locally
  • Applications: Research, development, etc.

Other Open-Source Models

  • Mistral
  • Mixtral
  • Other open-source models

Image Generation Models ​

Commercial Models

DALL-E

  • DALL-E 2
  • DALL-E 3
  • Features: High-quality image generation
  • Applications: Creative design, marketing, etc.

Midjourney

  • Midjourney v6
  • Features: Strong artistic quality
  • Applications: Art creation, design, etc.

Other Commercial Models

  • Adobe Firefly
  • Other commercial models

Open-Source Models

Stable Diffusion

  • Stable Diffusion XL
  • Stable Diffusion 3
  • Features: Open-source, customizable
  • Applications: Research, development, etc.

Other Open-Source Models

  • Flux
  • Other open-source models

Audio Generation Models ​

Speech Recognition

  • Whisper (OpenAI)
  • Features: Multilingual support
  • Applications: Transcription, translation, etc.

Speech Synthesis

  • ElevenLabs
  • Features: High-quality speech
  • Applications: Voiceover, podcasts, etc.

Music Generation

  • Suno AI
  • Udio
  • Features: AI music creation
  • Applications: Music creation, background music, etc.

Video Generation Models ​

Commercial Models

  • Sora (OpenAI)
  • Runway
  • Features: High-quality video generation
  • Applications: Video creation, advertising, etc.

Open-Source Models

  • Stable Video Diffusion
  • Other open-source models

Main Tools and Platforms ​

Development Frameworks ​

LangChain

  • Framework: Application development framework
  • Features: Modular, extensible
  • Applications: AI application development
  • Documentation Link

LlamaIndex

  • Framework: Data indexing framework
  • Features: Data connection, indexing
  • Applications: RAG applications
  • Documentation Link

Other Frameworks

  • Haystack
  • Semantic Kernel
  • Other frameworks

Deployment Platforms ​

Cloud Services

  • OpenAI API
  • Anthropic API
  • Google Cloud AI
  • Other cloud services

Self-Deployment

  • vLLM
  • TGI
  • Ollama
  • Other deployment tools

Development Tools ​

Prompt Tools

  • PromptBase
  • FlowGPT
  • Other prompt tools

Evaluation Tools

  • Promptfoo
  • Other evaluation tools

Monitoring Tools

  • LangSmith
  • Other monitoring tools

Application Scenarios ​

Content Creation ​

Text Creation

  • Article writing
  • Marketing copy
  • Creative writing
  • Other text creation

Image Creation

  • Art creation
  • Design assistance
  • Marketing materials
  • Other image creation

Audio Creation

  • Speech synthesis
  • Music creation
  • Sound design
  • Other audio creation

Video Creation

  • Video generation
  • Video editing
  • Animation production
  • Other video creation

Programming Assistance ​

Code Generation

  • Code completion
  • Code generation
  • Code optimization
  • Other code generation

Code Review

  • Code analysis
  • Bug detection
  • Code optimization
  • Other code review

Documentation Generation

  • API documentation
  • Technical documentation
  • User documentation
  • Other documentation generation

Data Analysis ​

Data Analysis

  • Data exploration
  • Data visualization
  • Data interpretation
  • Other data analysis

Report Generation

  • Analysis reports
  • Summary reports
  • Prediction reports
  • Other report generation

Customer Service ​

Intelligent Customer Service

  • Automatic replies
  • Q&A
  • Ticket processing
  • Other customer service functions

Chatbots

  • Dialogue systems
  • Q&A systems
  • Other chatbots

Learning Resources ​

Courses ​

Online Courses

  • Fast.ai courses
  • DeepLearning.AI courses
  • Other online courses

Practical Tutorials

  • Official tutorials
  • Community tutorials
  • Other practical tutorials

Documentation ​

Official Documentation

  • OpenAI documentation
  • Anthropic documentation
  • Other official documentation

Community Documentation

  • GitHub documentation
  • Community sharing
  • Other community documentation

Papers ​

Important Papers

  • Attention is All You Need
  • GPT series papers
  • Other important papers

Latest Research

  • arXiv papers
  • Conference papers
  • Other latest research

Best Practices ​

Prompt Engineering ​

Design Principles

  • Clear and specific
  • Provide context
  • Specify format
  • Iterative optimization

Optimization Techniques

  • Chain of Thought
  • Few-shot Learning
  • Other optimization techniques

Model Selection ​

Selection Criteria

  • Task requirements
  • Performance requirements
  • Cost considerations
  • Other factors

Evaluation Methods

  • Test evaluation
  • User feedback
  • Other evaluation methods

Security Considerations ​

Content Security

  • Content filtering
  • Output review
  • Other security measures

Data Security

  • Data encryption
  • Access control
  • Other security measures

Summary ​

Generative AI is rapidly changing the way we create content, and mastering these resources will help you better utilize this technology.

Key Points:

  1. Understand Model Types

    • Text generation models (GPT, Claude, LLaMA, etc.)
    • Image generation models (DALL-E, Midjourney, Stable Diffusion, etc.)
    • Audio generation models (Whisper, ElevenLabs, etc.)
    • Video generation models (Sora, Runway, etc.)
  2. Choose Appropriate Tools

    • Select models based on task requirements
    • Consider cost and performance
    • Evaluate open-source and closed-source options
    • Follow latest developments
  3. Master Best Practices

    • Prompt engineering
    • Model selection
    • Security considerations
  4. Continuous Learning

    • Follow latest research
    • Participate in community discussions
    • Practice new technologies
    • Share experiences

Remember:

  • Generative AI develops rapidly
  • Continuous learning is key
  • Security and ethics are important
  • Practice is the best way to learn

MIT Licensed