Beginners

• What is Retrieval-Augmented Generation (RAG)? What is any of this?

• We have libraries in Python and TypeScript; the Python lib has more features

• Installation and getting started:

• Python

• TypeScript

• I want to customize…

• LlamaHub is a collection of data connectors, agent tools and pre-written code

• We have notebooks that show how to use the tools on LlamaHub

• create-llama is a command-line tool that sets up a starter full-stack app for you

• Installation instructions

• We strongly recommend starting with this if you’re not sure where to start!

• The RAG CLI is a command-line tool that will index and query files for you

• Good for quickly checking if indexing documents works

• Building a low-code chatbot with Streamlit (this tool is called RAGs)

• What can I use?

• All the vector stores we support

• All the LLMs we support

• All the embedding models we support

• What’s the best way load and parse data?

• The ingestion pipeline

• How do I get full control over how my query engine works?

• The query pipeline

Intermediate

• We have several pre-built repos you may want to fork and modify:

• SEC Insights, an advanced full-stack RAG app using multi-document agents

• A full-stack demo repo using MongoDB Atlas

• A (very similar) demo repo using Azure Cosmos DB (a MongoDB clone)

• Create_llama_projects is a list of starter apps that can be installed with create-llama

• RAG over embedded tables

• Multi-document agent

• Multi-modal (images)

• Llamabot, a Slack bot

• Gives step-by-step instructions to build a Slack bot with memory

• LlamaParse, our advanced PDF parsing service

• There’s a special $500 + swag prize for best use of LlamaParse!

• Customizing prompts

• Hybrid search

• Vector search + keyword (BM25) search

Advanced

• These are mostly notebooks showing how we did it

• Customizing module types

• Every component — retrievers, parsers, query engines, agents — can be customized.

• Combining multiple data sources

• e.g. Slack + docs + API

• Routing across multiple sources

• Shows tool use, lets the LLM decide what tool to pick

• Multi-document queries

• Answering a single question that needs multiple sources to answer

• Examples of agents

• Autonomous decision-making using LlamaIndex

• Extracting structured outputs from unstructured data

• e.g. Turn web pages into JSON

• Multi-modal examples

• Interpreting images, retrieving images

• Auto-retrieval aka metadata filtering

• Get the LLM to pre-filter data by tag in your database

• Recursive retrieval

• Treat sub-nodes differently when retrieving

• Text to SQL

• Query a database using an LLM

• Pandas query engine

• Query ingested tables using Pandas

B站允许最多10个标签

不能发布太频繁, B站官方限制30秒一稿

some upload api

this api does not analyze the video content. it only predict tags from metadata:

https://member.bilibili.com/x/web/archive/tags

how to get upload_id

只有PC网页端有这个 手机端没有 可能是新功能

b站最新更新了这两个接口 需要传入upload_id 具体参数抓包获取

分区推荐 POST：

https://member.bilibili.com/x/vupre/web/archive/types/predict

标签推荐 GET（可能有延迟 需要请求两次 因为第一次标签数量较少）：

https://member.bilibili.com/x/vupre/web/tag/recommend

获取活动标签:

https://member.bilibili.com/x/vupre/web/topic/type?type_id=21&pn=0&ps=200&title=20210210_298667075925_waou_5s&t=1667530591393

和股票有关的程序必须运行在服务器上面 要有ecc 网速要快

交易接口

现在哪些券商的TradeX.dll接口还能用 需要注册论坛账号 达到要求才能浏览内容

trade.dll tradex.dll

tradex.dll header file

bqtradex A simple tradex api mock dll, for easily internal debug your app

Quantaxis

tdxtradeserver

tradex-api

tdxapi2

alphaquant

数据来源

逐笔数据是计算涨速的关键因素

ashare

quantaxis secretely using pytdx and tdxtradeserver as backends

akshare

获取涨速

1
2
3
4

import akshare as ak
stock_zh_a_spot_em_df = ak.stock_zh_a_spot_em()
print(stock_zh_a_spot_em_df)

qstock

efinance

baostock

pytdx and docs, must connect to tdx server before operate

pytdx2 fixed some problems

mootdx actually using pytdx as backend

abquant-data using pytdx as backend

计算涨速等数据

pysnowball雪球数据源

chromedriver based xueqiu api

获取雪球cookie

雪球tick级别数据获取

zipline_chstock 本地化zipline，并对其进行部分加工，适用于国内 day,minute 和tick数据的回测

新浪财经api

语音转文字 asr stt speech to text

online

字说APP的api

逆向搜狗输入法 绕过签名验证

搜狗输入法apk的api

微软stt

https://github.com/cuberwr/bilibiliSTT

多家免费stt

https://github.com/1c7/Translate-Subtitle-File

offline

https://github.com/metavoiceio/metavoice-src

pyannote segment audio according to different speakers, detect voice activity

speechbrain very advanced speech related ai library, with almost everything related to speech

vosk

paddlespeech

paper of Google USM (universal speech model) supporting 1000 languages

whisper.cpp perform fast voice to text operation using cpu rather than gpu

whisperx improve time accuracy with forced alignment

whisper gui buzz

whisper by openai, with multilingual and translation avaliable, can detect under background music and noise, with slience,

国内音乐平台api

https://listen1.github.io/listen1/

https://github.com/LIU9293/musicafe

https://github.com/872409/music-get

https://github.com/HuberTRoy/MusicBox

https://github.com/caiyonglong/MusicApi

https://github.com/caiyonglong/MusicLake

https://github.com/QiuChenly/QQFlacMusicDownloader

https://github.com/Rain120/qq-music-api

https://github.com/sunzongzheng/musicApi

https://github.com/sunzongzheng/music

rapidapi do not use this

imgur funny gifs

https://giphy.com

video dataset:

youtube8m by google

giphy gif apis:

https://github.com/austinkelleher/giphy-api

https://github.com/Giphy/giphy-js

https://github.com/sogamoso/giphy

https://github.com/Giphy/GiphyAPI

https://developers.giphy.com/branch/master/docs/

https://github.com/shaunduncan/giphypop

enternainment apis and more, search for free apis/public apis:

https://apipheny.io/free-api/#entertainment-apis

find things from public apis:

https://github.com/public-apis/public-apis

download video from ifunny.co

https://github.com/vidovichb/iFunny_Downloader

memes app from reddit

https://github.com/victorqribeiro/memes

ml algorithm to download funny music videos

https://github.com/dfarren/funny_music_videos

create funny videos

https://github.com/PhotoBoxPW/VideoBox

search gifs from bukk.it

https://github.com/olivierlacan/gifhub

https://bukk.it

搞笑视频去水印

https://github.com/5ime/video_spider

搞笑图片 搞笑音频抓取

https://github.com/zhaofucheng1129/KuailewoAppServer

搞笑视频

https://github.com/ecitlm/Node-SpliderApi

搞笑视频 哔哩哔哩封面图获取

https://github.com/iqiqiya/iqiqiya-API