Chapter-5, Possible TypeError

[Ab-2k]

I encountered a TypeError when indexing the dataset object using a NumPy integer. The error occurred while generating document visualizations with BERTopic using the following code snippet:
`fig = topic_model.visualize_documents(
titles,
reduced_embeddings=reduced_embeddings,
width=1200,
hide_annotations=True
)

fig.update_layout(font=dict(size=16))`

[MaartenGr]

Could you share the full stack trace? I haven't been able to reproduce the issue. Did you use google colab?

[Ab-2k]

Thanks for looking into this!
Yes, I was running this on Google Colab.

I encountered the following error:

TypeError                                 Traceback (most recent call last)
/tmp/ipython-input-1776326136.py in <cell line: 0>()
----> 1 fig = topic_model.visualize_documents(
      2     titles,
      3     reduced_embeddings=reduced_embeddings,
      4     width=1200,
      5     hide_annotations=True
)

/usr/local/lib/python3.12/dist-packages/bertopic/_bertopic.py in visualize_documents(self, docs, topics, embeddings, reduced_embeddings, sample, hide_annotations, hide_document_hover, custom_labels, title, width, height)
   2535         check_is_fitted(self)
   2536         check_documents_type(docs)
-> 2537         return plotting.visualize_documents(
   2538             self,
   2539             docs=docs,

/usr/local/lib/python3.12/dist-packages/bertopic/plotting/_documents.py in visualize_documents(topic_model, docs, topics, embeddings, reduced_embeddings, sample, hide_annotations, hide_document_hover, custom_labels, title, width, height)
    103 
    104     df = pd.DataFrame({"topic": np.array(topic_per_doc)[indices]})
--> 105     df["doc"] = [docs[index] for index in indices]
    106     df["topic"] = [topic_per_doc[index] for index in indices]
    107 

/usr/local/lib/python3.12/dist-packages/datasets/formatting/formatting.py in _raise_bad_key_type(key)
     42 
     43 def _raise_bad_key_type(key: Any):
---> 44     raise TypeError(
     45         f"Wrong key type: '{key}' of type '{type(key)}'. Expected one of int, slice, range, str or Iterable."
     46     )

TypeError: Wrong key type: '7076' of type '<class 'numpy.int64'>'. Expected one of int, slice, range, str or Iterable.

It turned out the issue occurred because my documents (titles) were coming from a Hugging Face Dataset object, which doesn’t accept NumPy integer indexing.

I resolved it by explicitly converting the indices to standard Python integers when passing the documents to visualize_documents:

fig = topic_model.visualize_documents(
    docs=[titles[int(i)] for i in range(len(titles))],  
    reduced_embeddings=reduced_embeddings,
    width=1200,
    hide_annotations=True
)


fig.update_layout(font=dict(size=16))