ImportError: cannot import name 'abc' #82

yangzhao5566 · 2018-05-07T03:01:57Z

from bson.py3compat import abc, string_type, PY3, text_type
ImportError: cannot import name 'abc'

ppython · 2018-05-15T18:27:56Z

This is frustrating as there is no more tags(versions) on github to easily track the problem.

I'm also trying to revert to 0.5.2, and I get

bson/setup.py", line 8, in < module >
from pip import get_installed_distributions
ImportError: cannot import name get_installed_distributions

which is related to a bad use of pip (pypa/pip#5243)

If by any chance you happen to have this error with pymongo; try this https://stackoverflow.com/a/46166075

JinXJinX · 2018-10-10T00:33:53Z

uninstall bson, then install pymongo will solve this.

pip uninstall bson
pip install pymongo

I think another bson package is what you are looking for. https://github.com/mongodb/mongo-python-driver

Affan-Ali · 2018-10-30T05:24:38Z

uninstall bson and pymongo and reinstall pymongo using conda:

pip uninstall bson
pip uninstall pymongo
conda install -c anaconda pymongo

shlomiLan · 2018-11-20T22:17:49Z

I had to add pymongo==3.7.2 to my requirements file, with pymongo==3.7.1 I got this same error.

Update: still not working properly. My app runs on Heroku and only there I see this issue, can't reproduce on my local machine or on Travis-CI

Parkayun · 2018-11-21T11:00:32Z

It seems that this issue is raising when installed py-bson and pymongo both.
But, this package designed with independent package (don't use pymongo togehter).

If anyone encounter this issue whithout pymongo, please comment it with how to reproduce(environments and more).

Thank you.

shlomiLan · 2018-11-21T16:47:02Z

I'm not using them both, I tried to install pymingo to fix this bug.
You can see here in which package s I use https://github.com/shlomiLan/slots_tracker_server/blob/master/requirements.txt

The problem is that I'm not getting this error on my local machine (Mac) or in the CI (Travis), only on heroku.
Let me know if there is any more information that I can give you.

Update: I have posted a question on StackOverFlow with more info

hbrannan · 2018-11-27T02:04:06Z

There seems to remain a lack of clarity, so, from the most useful SO post I found on this issue from @bauman.space:

pymongo>=2.7.1 directive overwrites your bson installation

from https://github.com/mongodb/mongo-python-driver

Do not install the "bson" package from pypi. PyMongo comes with its own bson package; doing easy_install bson or pip install bson installs a third-party package that is incompatible with PyMongo.

assuming you really want to use the 3rd party bson, you'll need to

pip uninstall bson (removes the overwritten bson that landed via pymongo package) pip install bson (reinstalls the py-bson package) or you could patch the pymongo install to remove the collections.abc line (evidently you don't really need it?), but messing with production packaged code is questionable.

pymongo module https://github.com/mongodb/mongo-python-driver/blob/master/bson/py3compat.py#L22-L25

py-bson module you are trying to use. https://github.com/py-bson/bson/blob/master/bson/py3compat.py#L22-L24

shlomiLan · 2018-11-27T06:16:07Z

There seems to remain a lack of clarity, so, from the most useful SO post I found on this issue from @bauman.space:

pymongo>=2.7.1 directive overwrites your bson installation

from https://github.com/mongodb/mongo-python-driver

Do not install the "bson" package from pypi. PyMongo comes with its own bson package; doing easy_install bson or pip install bson installs a third-party package that is incompatible with PyMongo.

assuming you really want to use the 3rd party bson, you'll need to

pip uninstall bson (removes the overwritten bson that landed via pymongo package) pip install bson (reinstalls the py-bson package) or you could patch the pymongo install to remove the collections.abc line (evidently you don't really need it?), but messing with production packaged code is questionable.

pymongo module https://github.com/mongodb/mongo-python-driver/blob/master/bson/py3compat.py#L22-L25

py-bson module you are trying to use. https://github.com/py-bson/bson/blob/master/bson/py3compat.py#L22-L24

I posted that question, you can see it in the previous comment :)
Now I get a different but similar error:

    Traceback (most recent call last):
       File "/app/.heroku/python/lib/python3.6/site-packages/gunicorn/arbiter.py", line 583, in spawn_worker
         worker.init_process()
       File "/app/.heroku/python/lib/python3.6/site-packages/gunicorn/workers/base.py", line 129, in init_process
         self.load_wsgi()
       File "/app/.heroku/python/lib/python3.6/site-packages/gunicorn/workers/base.py", line 138, in load_wsgi
         self.wsgi = self.app.wsgi()
       File "/app/.heroku/python/lib/python3.6/site-packages/gunicorn/app/base.py", line 67, in wsgi
         self.callable = self.load()
       File "/app/.heroku/python/lib/python3.6/site-packages/gunicorn/app/wsgiapp.py", line 52, in load
         return self.load_wsgiapp()
       File "/app/.heroku/python/lib/python3.6/site-packages/gunicorn/app/wsgiapp.py", line 41, in load_wsgiapp
         return util.import_app(self.app_uri)
       File "/app/.heroku/python/lib/python3.6/site-packages/gunicorn/util.py", line 350, in import_app
         __import__(module)
       File "/app/slots_tracker_server/__init__.py", line 5, in <module>
         from mongoengine import connect
       File "/app/.heroku/python/lib/python3.6/site-packages/mongoengine/__init__.py", line 2, in <module>
         from mongoengine import connection
       File "/app/.heroku/python/lib/python3.6/site-packages/mongoengine/connection.py", line 1, in <module>
         from pymongo import MongoClient, ReadPreference, uri_parser
       File "/app/.heroku/python/lib/python3.6/site-packages/pymongo/__init__.py", line 77, in <module>
         from pymongo.collection import ReturnDocument
       File "/app/.heroku/python/lib/python3.6/site-packages/pymongo/collection.py", line 20, in <module>
         from bson.code import Code
       File "/app/.heroku/python/lib/python3.6/site-packages/bson/code.py", line 18, in <module>
         from bson.py3compat import abc, string_type, PY3, text_type
     ModuleNotFoundError: No module named 'bson.py3compat'

hbrannan · 2018-11-27T16:51:44Z

Haha, yes, see that now. Well, thanks for posting.

I believe your pymongo file may remain corrupted/ partially overwritten by the earlier bson install. I had this same issue, and per the thread, attempted a pymongo reinstall to resolve.

My virtual env, however, seems to have a bit of an issue with updating, so reinstalling pymongo did not resolve the issue.

I deleted the generated .venv repo, and ran a blanket install. Now the issues are resolved for me.
I am using pipenv & had to create an empty .venv folder for that kind of reinstall to work. From comments online, it appears that people using virtualenv, at least, are having similar issues.

So for me,
pipenv uninstall bson
rm -rf .venv
mkdir .venv
pipenv install

shlomiLan · 2018-11-27T19:00:24Z

I'm running on Heroku so I can't control how the environment is been set up. I run heroku repo:purge_cache -a APP_NAME and redeploy the app from Git and now it seems to be working.

zyl916369 · 2018-11-30T01:25:32Z

uninstall bson and pymongo and reinstall pymongo using conda:
pip uninstall bson
pip uninstall pymongo
conda install -c anaconda pymongo 

Thanks , solved the issue

jesse-homes · 2019-02-20T16:57:43Z

I have Python 3.7.0 running in a virtual environment on MacBook Pro Mojave 10.14.3
I had installed PyMongo before BSON, then doing geo 2d stuff needed BSON. Added BSON using pypl pip and would not work.
Uninstalled PyMongo and BSON
Then installed BSON [Successfully installed bson-0.5.7]
Then installed PyMongo [Successfully installed pymongo-3.7.2]
Now it works fine.

lionandbull · 2019-04-15T03:34:01Z

I had to add pymongo==3.7.2 to my requirements file, with pymongo==3.7.1 I got this same error.

Update: still not working properly. My app runs on Heroku and only there I see this issue, can't reproduce on my local machine or on Travis-CI

It works for me.

JosephP91 · 2019-04-24T16:09:09Z

I have Python 3.7.0 running in a virtual environment on MacBook Pro Mojave 10.14.3
I had installed PyMongo before BSON, then doing geo 2d stuff needed BSON. Added BSON using pypl pip and would not work.
Uninstalled PyMongo and BSON
Then installed BSON [Successfully installed bson-0.5.7]
Then installed PyMongo [Successfully installed pymongo-3.7.2]
Now it works fine.

Confirmed. If you install bson first and then pymongo, it works.

This dependency is conflicting with pymongo and resulting in the following exception: ---- ImportError while importing test module '/var/lib/jenkins/workspace/cmk_master/unit_tests/check_mk/tests/unit/agents/plugins/test_mk_mongodb.py'. Hint: make sure your test modules/packages have valid Python names. Traceback: ../virtual-envs/2.7/.venv/local/lib/python2.7/site-packages/_pytest/python.py:507: in _importtestmodule mod = self.fspath.pyimport(ensuresyspath=importmode) ../virtual-envs/2.7/.venv/local/lib/python2.7/site-packages/py/_path/local.py:701: in pyimport __import__(modname) ../virtual-envs/2.7/.venv/local/lib/python2.7/site-packages/_pytest/assertion/rewrite.py:304: in load_module exec(co, mod.__dict__) unit/agents/plugins/test_mk_mongodb.py:5: in <module> from bson.json_util import loads ../virtual-envs/2.7/.venv/local/lib/python2.7/site-packages/bson/json_util.py:116: in <module> from pymongo.errors import ConfigurationError ../virtual-envs/2.7/.venv/local/lib/python2.7/site-packages/pymongo/__init__.py:77: in <module> from pymongo.collection import ReturnDocument ../virtual-envs/2.7/.venv/local/lib/python2.7/site-packages/pymongo/collection.py:20: in <module> from bson.code import Code ../virtual-envs/2.7/.venv/local/lib/python2.7/site-packages/bson/code.py:18: in <module> from bson.py3compat import abc, string_type, PY3, text_type E ImportError: cannot import name abc --- According to py-bson/bson#82 both packages are conflicting and bson needs to be cleaned up. Change-Id: I82383157176ba3230408285c142d7fc92cedccae

dparkar · 2019-10-16T23:51:18Z

Coming across the same thing today. Any suggestions on how to detect the root cause ?

samhavens · 2019-10-23T22:10:12Z

@dparkar the following (based on what worked for others in this thread) worked for me:

pip uninstall -y bson pymongo \
&& pip install bson==0.5.7 \
&& pip install pymongo==3.7.2

sadakmed · 2020-03-06T01:15:20Z

@Affan-Ali this guy is great

pip uninstall bson
pip uninstall pymongo
conda install -c anaconda pymongo

This solve it, is better to install with conda than pip if u r using anaconda

ilfrich · 2020-04-20T08:14:45Z

TLDR; remove bson from your requirements.txt, as pymongo already provides it and check that none of your other dependencies include bson. Always put pymongo AFTER anything else in the requirements.txt.

The problem appears to be that pymongo already delivers the bson module and relies on it's own module: https://github.com/mongodb/mongo-python-driver/tree/master/bson

This is the problem with pip, where 2 packages can deliver the same module name.

The issue can be caused by the following 2 scenarios:

Scenario 1: You use pymongo and bson in the same requirements.txt file
Scenario 2: You use pymongo and a package that depends on bson

Steps to reproduce require the following 3 files:

Dockerfile

FROM python:3.6
COPY requirements.txt .
COPY test.py .
RUN pip install -r requirements.txt
RUN python3 test.py

requirements.txt

pymongo
bson

test.py

print("\n\nTest successful\n===============\n")

Then you simply run docker build -t bson-test-image --no-cache .

Weirdly, if you have a transitive dependency to bson (e.g. you depend on X and X depends on bson), it works ~50% of the time (I ran the build 10x and it failed half of the time). Weird race condition.

In summary: this repository should only be used, if you ONLY need bson functionality and don't want to use MongoDB. Otherwise omit it entirely as you can import bson if you have pymongo installed.

exaland · 2020-06-07T11:42:46Z

I have same problem

I resolved with uninstall with pip and install with pip3

pip uninstall bson
pip uninstall pymongo

pip3 install bson
pip3 install pymongo

Parkayun · 2020-06-07T11:53:24Z

guys, I uploaded pybson to pypi for looking on demands. (same package with bson.)
pip install pybson
#41

satendrasingh51 · 2020-09-18T12:46:59Z

This worked for me:

pip uninstall bson
pip uninstall pymongo
pip install pymongo

Joshuah143 · 2021-08-04T21:57:49Z

Worth noting that I experienced the same issue today running the latest versions of each package. Solved by removing bson

yangzhao5566 closed this as completed May 7, 2018

yangzhao5566 reopened this May 7, 2018

Parkayun added the bug label May 21, 2018

Parkayun closed this as completed Oct 10, 2018

DongOnee mentioned this issue May 28, 2019

bson DongOnee/lova-backend#1

Closed

argenisleon mentioned this issue Jun 8, 2019

installation hi-primus/optimus#558

Closed

banderlog mentioned this issue Jul 9, 2019

Cannot import module Binary #73

Closed

This was referenced Aug 6, 2019

[BEAM-5148] Implement MongoDB IO for Python SDK apache/beam#8826

Merged

[BEAM-5148] Optionally load bson apache/beam#9308

Merged

abhisheksarkar30 mentioned this issue Sep 28, 2019

Issue when running gite abhisheksarkar30/git-extras-tool#2

Closed

holgerschmeisky mentioned this issue Oct 25, 2019

Startup fails non-deterministically due to transient dependency on both bson and pymongo flairNLP/flair#1245

Closed

NAshwinKumar mentioned this issue Oct 9, 2020

Version mismatch caused by bson package Acquil/deep-read#28

Closed

abhaasgoyal mentioned this issue Feb 1, 2021

Fix breaking dependencies between pymongo and bson frg-fossee/eSim-Cloud#203

Merged

cc1000 added a commit to cc1000/DevOps-Course-Starter that referenced this issue Mar 17, 2021

Flip install order of pymongo and bson (py-bson/bson#82 (comment))

8813b86

superbsky mentioned this issue Mar 30, 2021

docker-compose failed to start app_wes-worker_1 and app_wes_1 elixir-cloud-aai/cwl-WES#217

Closed

Zih0 mentioned this issue Aug 18, 2021

bson pymongo 충돌 PETCH-KR/Backend-Django#29

Closed

oriolpiera mentioned this issue Feb 7, 2024

✅ Change pymongo version Som-Energia/plantmeter#6

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ImportError: cannot import name 'abc' #82

ImportError: cannot import name 'abc' #82

yangzhao5566 commented May 7, 2018 •

edited

Loading

ppython commented May 15, 2018 •

edited

Loading

JinXJinX commented Oct 10, 2018

Affan-Ali commented Oct 30, 2018 •

edited

Loading

shlomiLan commented Nov 20, 2018 •

edited

Loading

Parkayun commented Nov 21, 2018

shlomiLan commented Nov 21, 2018 •

edited

Loading

hbrannan commented Nov 27, 2018

shlomiLan commented Nov 27, 2018

hbrannan commented Nov 27, 2018 •

edited

Loading

shlomiLan commented Nov 27, 2018

zyl916369 commented Nov 30, 2018

jesse-homes commented Feb 20, 2019

lionandbull commented Apr 15, 2019

JosephP91 commented Apr 24, 2019

dparkar commented Oct 16, 2019

samhavens commented Oct 23, 2019

sadakmed commented Mar 6, 2020

ilfrich commented Apr 20, 2020 •

edited

Loading

exaland commented Jun 7, 2020

Parkayun commented Jun 7, 2020 •

edited

Loading

satendrasingh51 commented Sep 18, 2020

Joshuah143 commented Aug 4, 2021

ImportError: cannot import name 'abc' #82

ImportError: cannot import name 'abc' #82

Comments

yangzhao5566 commented May 7, 2018 • edited Loading

ppython commented May 15, 2018 • edited Loading

JinXJinX commented Oct 10, 2018

Affan-Ali commented Oct 30, 2018 • edited Loading

shlomiLan commented Nov 20, 2018 • edited Loading

Parkayun commented Nov 21, 2018

shlomiLan commented Nov 21, 2018 • edited Loading

hbrannan commented Nov 27, 2018

shlomiLan commented Nov 27, 2018

hbrannan commented Nov 27, 2018 • edited Loading

shlomiLan commented Nov 27, 2018

zyl916369 commented Nov 30, 2018

jesse-homes commented Feb 20, 2019

lionandbull commented Apr 15, 2019

JosephP91 commented Apr 24, 2019

dparkar commented Oct 16, 2019

samhavens commented Oct 23, 2019

sadakmed commented Mar 6, 2020

ilfrich commented Apr 20, 2020 • edited Loading

exaland commented Jun 7, 2020

Parkayun commented Jun 7, 2020 • edited Loading

satendrasingh51 commented Sep 18, 2020

Joshuah143 commented Aug 4, 2021

yangzhao5566 commented May 7, 2018 •

edited

Loading

ppython commented May 15, 2018 •

edited

Loading

Affan-Ali commented Oct 30, 2018 •

edited

Loading

shlomiLan commented Nov 20, 2018 •

edited

Loading

shlomiLan commented Nov 21, 2018 •

edited

Loading

hbrannan commented Nov 27, 2018 •

edited

Loading

ilfrich commented Apr 20, 2020 •

edited

Loading

Parkayun commented Jun 7, 2020 •

edited

Loading