Topic modeling is about finding themes (topics) within clusters of textual documents. The topics are labels (keywords) that capture the meaning of the cluster.

Cluster 1: ['cats', 'dogs', 'elephants', 'birds'] ==> topic: animals Cluster 2: ['cars', 'trains', 'planes'] ==> topic: car
BERTopic is a modular topic modeling technique that extract topic representations. BERTopic uses two steps to extract topics: text clustering and representation topics. The text clustering step provides BERTopic with the clusters of the documents that are semantically similar.

See this page for more details about BERTopic:
https://maartengr.github.io/BERTopic/index.html

Example: Creating topics of a set of words

Required modules:
$ pip install bertopic
Python code:
from sentence_transformers import SentenceTransformer from umap import UMAP from hdbscan import HDBSCAN from bertopic import BERTopic sentences = ['cats', 'dogs', 'elephants', 'birds', 'cars', 'trains', 'planes'] model = SentenceTransformer("sentence-transformers/all-MiniLM-L12-v2") embeddings = model.encode(sentences) topic_model = BERTopic( embedding_model=model, umap_model=UMAP(n_components=5, random_state=42), hdbscan_model=HDBSCAN(min_cluster_size=2), verbose=True ).fit(sentences, embeddings) print("Topics info:") print(topic_model.get_topic_info(), sep="\n") print("Topic 0 info:") print(topic_model.get_topic(0), sep="\n") print("Topic 1 info:") print(topic_model.get_topic(1)) # save the barchart figure fig = topic_model.visualize_barchart() fig.write_html("bertopic-barchart-figure.html")
Output:
Topics info: Topic Count Name Representation Representative_Docs 0 0 4 0_cats_birds_elephants_dogs [cats, birds, elephants, dogs, , , , , , ] [birds, cats, dogs] 1 1 3 1_cars_trains_planes_ [cars, trains, planes, , , , , , , ] [planes, cars, trains] Topic 0 info: [ ('cats', np.float64(0.34657359027997264)), ('birds', np.float64(0.34657359027997264)), ('elephants', np.float64(0.34657359027997264)), ('dogs', np.float64(0.34657359027997264)), ('', 1e-05), ('', 1e-05), ('', 1e-05), ('', 1e-05), ('', 1e-05), ('', 1e-05) ] Topic 1 info: [ ('cars', np.float64(0.46209812037329684)), ('trains', np.float64(0.46209812037329684)), ('planes', np.float64(0.46209812037329684)), ('', 1e-05), ('', 1e-05), ('', 1e-05), ('', 1e-05), ('', 1e-05), ('', 1e-05), ('', 1e-05) ]
Chart of the topics:

Topics are represented by the main keywords, which are concatenated with the underscore character (“_”). A specific topic with the tag "-1" can be listed and should include all keywords that do not match a specific topic. This topic may also include outliers which are candidates that do not match any of the found topics.

BERTopic can use a model to generate proper labels for the topics.

For that we need to craft a prompt that should have two parts:

• A subset of documents that best represent the topics that will inserted using the [DOCUMENTS] tag.
  
• The keywords that make up the topics of the cluster that will be inserted using the [KEYWORDS] tag.
  

INPUT + keywords + documents + data I have a topic that contains the following documents: [DOCUMENTS] The topic is described by the following keywords: [KEYWORDS] Based on the above information, give a short label of the topic. OUTPUT: <topic labels>
Example: Creating labeled topics of a set of words

Python code:
from transformers import pipeline from bertopic.representation import TextGeneration from sentence_transformers import SentenceTransformer from umap import UMAP from hdbscan import HDBSCAN from bertopic import BERTopic sentences = ['cats', 'dogs', 'elephants', 'birds', 'cars', 'trains', 'planes'] model = SentenceTransformer("sentence-transformers/all-MiniLM-L12-v2") embeddings = model.encode(sentences) topic_model = BERTopic( embedding_model=model, umap_model=UMAP(n_components=5, random_state=42), hdbscan_model=HDBSCAN(min_cluster_size=2), verbose=True ).fit(sentences, embeddings) prompt = """The following documents belong to the same topic: [DOCUMENTS] The following keywords provide details on this topic: '[KEYWORDS]'. According to the documents and keywords, what is this topic about?""" generator = pipeline("text2text-generation", model="google/flan-t5-small") representation_model = TextGeneration( generator, prompt=prompt, doc_length=50, tokenizer="whitespace" ) topic_model.update_topics(sentences, representation_model=representation_model) print("topic info") print(topic_model.get_topic_info())
Output:
Topics info: Topic Count Name Representation Representative_Docs 0 0 4 0_animals___ [animals, , , , , , , , , ] [birds, cats, dogs] 1 1 3 1_car___ [car, , , , , , , , , ] [planes, cars, trains]