In this notebook we will be going over generating embeddings of book descriptions with OpenAI and using those embeddings within Zilliz to find relevant books. The dataset in this example is sourced from HuggingFace datasets, and contains a little over 1 million title-description pairs.
Lets begin by first downloading the required libraries for this notebook:
openaiis used for communicating with the OpenAI embedding service
pymilvusis used for communicating with the Zilliz instance
datasetsis used for downloading the dataset
tqdmis used for the progress bars