Skip to content

Generative AI Resources

Resource Source

Repository: https://github.com/filipecalegario/awesome-generative-ai

Introduction: This is a carefully curated list of generative AI resources, covering various aspects of generative AI including models, tools, applications, tutorials, etc., helping you comprehensively understand and use generative AI technology.

Generative AI Overview

What is Generative AI?

Generative AI refers to AI systems capable of creating new content, including:

  • Text generation (e.g., GPT, Claude)
  • Image generation (e.g., DALL-E, Midjourney)
  • Audio generation (e.g., Whisper, AudioLM)
  • Video generation (e.g., Sora, Runway)
  • Code generation (e.g., Codex, StarCoder)

Core Technologies of Generative AI

  1. Large Language Models (LLM)

    • GPT series (GPT-3, GPT-4)
    • Claude series
    • LLaMA series
    • Other open-source models
  2. Diffusion Models

    • Stable Diffusion
    • DALL-E
    • Midjourney
    • Other image generation models
  3. Multimodal Models

    • GPT-4V
    • Claude 3
    • Gemini
    • Other multimodal models

Main Models

Text Generation Models

Closed-Source Models

GPT Series

  • GPT-3.5
  • GPT-4
  • GPT-4 Turbo
  • Features: Powerful text generation capabilities
  • Applications: Dialogue, writing, programming, etc.

Claude Series

  • Claude 2
  • Claude 3
  • Features: Long text support, safe and reliable
  • Applications: Long document analysis, dialogue, etc.

Other Closed-Source Models

  • Gemini (Google)
  • PaLM (Google)
  • Other commercial models

Open-Source Models

LLaMA Series

  • LLaMA 2
  • LLaMA 3
  • Features: Powerful performance, can be deployed locally
  • Applications: Research, development, etc.

Other Open-Source Models

  • Mistral
  • Mixtral
  • Other open-source models

Image Generation Models

Commercial Models

DALL-E

  • DALL-E 2
  • DALL-E 3
  • Features: High-quality image generation
  • Applications: Creative design, marketing, etc.

Midjourney

  • Midjourney v6
  • Features: Strong artistic quality
  • Applications: Art creation, design, etc.

Other Commercial Models

  • Adobe Firefly
  • Other commercial models

Open-Source Models

Stable Diffusion

  • Stable Diffusion XL
  • Stable Diffusion 3
  • Features: Open-source, customizable
  • Applications: Research, development, etc.

Other Open-Source Models

  • Flux
  • Other open-source models

Audio Generation Models

Speech Recognition

  • Whisper (OpenAI)
  • Features: Multilingual support
  • Applications: Transcription, translation, etc.

Speech Synthesis

  • ElevenLabs
  • Features: High-quality speech
  • Applications: Voiceover, podcasts, etc.

Music Generation

  • Suno AI
  • Udio
  • Features: AI music creation
  • Applications: Music creation, background music, etc.

Video Generation Models

Commercial Models

  • Sora (OpenAI)
  • Runway
  • Features: High-quality video generation
  • Applications: Video creation, advertising, etc.

Open-Source Models

  • Stable Video Diffusion
  • Other open-source models

Main Tools and Platforms

Development Frameworks

LangChain

  • Framework: Application development framework
  • Features: Modular, extensible
  • Applications: AI application development
  • Documentation Link

LlamaIndex

  • Framework: Data indexing framework
  • Features: Data connection, indexing
  • Applications: RAG applications
  • Documentation Link

Other Frameworks

  • Haystack
  • Semantic Kernel
  • Other frameworks

Deployment Platforms

Cloud Services

  • OpenAI API
  • Anthropic API
  • Google Cloud AI
  • Other cloud services

Self-Deployment

  • vLLM
  • TGI
  • Ollama
  • Other deployment tools

Development Tools

Prompt Tools

  • PromptBase
  • FlowGPT
  • Other prompt tools

Evaluation Tools

  • Promptfoo
  • Other evaluation tools

Monitoring Tools

  • LangSmith
  • Other monitoring tools

Application Scenarios

Content Creation

Text Creation

  • Article writing
  • Marketing copy
  • Creative writing
  • Other text creation

Image Creation

  • Art creation
  • Design assistance
  • Marketing materials
  • Other image creation

Audio Creation

  • Speech synthesis
  • Music creation
  • Sound design
  • Other audio creation

Video Creation

  • Video generation
  • Video editing
  • Animation production
  • Other video creation

Programming Assistance

Code Generation

  • Code completion
  • Code generation
  • Code optimization
  • Other code generation

Code Review

  • Code analysis
  • Bug detection
  • Code optimization
  • Other code review

Documentation Generation

  • API documentation
  • Technical documentation
  • User documentation
  • Other documentation generation

Data Analysis

Data Analysis

  • Data exploration
  • Data visualization
  • Data interpretation
  • Other data analysis

Report Generation

  • Analysis reports
  • Summary reports
  • Prediction reports
  • Other report generation

Customer Service

Intelligent Customer Service

  • Automatic replies
  • Q&A
  • Ticket processing
  • Other customer service functions

Chatbots

  • Dialogue systems
  • Q&A systems
  • Other chatbots

Learning Resources

Courses

Online Courses

  • Fast.ai courses
  • DeepLearning.AI courses
  • Other online courses

Practical Tutorials

  • Official tutorials
  • Community tutorials
  • Other practical tutorials

Documentation

Official Documentation

  • OpenAI documentation
  • Anthropic documentation
  • Other official documentation

Community Documentation

  • GitHub documentation
  • Community sharing
  • Other community documentation

Papers

Important Papers

  • Attention is All You Need
  • GPT series papers
  • Other important papers

Latest Research

  • arXiv papers
  • Conference papers
  • Other latest research

Best Practices

Prompt Engineering

Design Principles

  • Clear and specific
  • Provide context
  • Specify format
  • Iterative optimization

Optimization Techniques

  • Chain of Thought
  • Few-shot Learning
  • Other optimization techniques

Model Selection

Selection Criteria

  • Task requirements
  • Performance requirements
  • Cost considerations
  • Other factors

Evaluation Methods

  • Test evaluation
  • User feedback
  • Other evaluation methods

Security Considerations

Content Security

  • Content filtering
  • Output review
  • Other security measures

Data Security

  • Data encryption
  • Access control
  • Other security measures

Summary

Generative AI is rapidly changing the way we create content, and mastering these resources will help you better utilize this technology.

Key Points:

  1. Understand Model Types

    • Text generation models (GPT, Claude, LLaMA, etc.)
    • Image generation models (DALL-E, Midjourney, Stable Diffusion, etc.)
    • Audio generation models (Whisper, ElevenLabs, etc.)
    • Video generation models (Sora, Runway, etc.)
  2. Choose Appropriate Tools

    • Select models based on task requirements
    • Consider cost and performance
    • Evaluate open-source and closed-source options
    • Follow latest developments
  3. Master Best Practices

    • Prompt engineering
    • Model selection
    • Security considerations
  4. Continuous Learning

    • Follow latest research
    • Participate in community discussions
    • Practice new technologies
    • Share experiences

Remember:

  • Generative AI develops rapidly
  • Continuous learning is key
  • Security and ethics are important
  • Practice is the best way to learn

MIT Licensed