johanna@Johannas-MBP Scrapers $ pip install shub -bash: pip: command not found johanna@Johannas-MBP Scrapers $ sudo easy_install pip Password: Searching for pip Reading https://pypi.python.org/simple/pip/ Best match: pip 9.0.1 Downloading https://pypi.python.org/packages/11/b6/abcb525026a4be042b486df43905d6893fb04f05aac21c32c638e939e447/pip-9.0.1.tar.gz#md5=35f01da33009719497f01a4ba69d63c9 Processing pip-9.0.1.tar.gz Writing /tmp/easy_install-rp2OMj/pip-9.0.1/setup.cfg Running pip-9.0.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-rp2OMj/pip-9.0.1/egg-dist-tmp-iPaJ4X /System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'python_requires' warnings.warn(msg) warning: no previously-included files found matching '.coveragerc' warning: no previously-included files found matching '.mailmap' warning: no previously-included files found matching '.travis.yml' warning: no previously-included files found matching '.landscape.yml' warning: no previously-included files found matching 'pip/_vendor/Makefile' warning: no previously-included files found matching 'tox.ini' warning: no previously-included files found matching 'dev-requirements.txt' warning: no previously-included files found matching 'appveyor.yml' no previously-included directories found matching '.github' no previously-included directories found matching '.travis' no previously-included directories found matching 'docs/_build' no previously-included directories found matching 'contrib' no previously-included directories found matching 'tasks' no previously-included directories found matching 'tests' creating /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg Extracting pip-9.0.1-py2.7.egg to /Library/Python/2.7/site-packages Adding pip 9.0.1 to easy-install.pth file Installing pip script to /usr/local/bin Installing pip2.7 script to /usr/local/bin Installing pip2 script to /usr/local/bin Installed /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg Processing dependencies for pip Finished processing dependencies for pip johanna@Johannas-MBP Scrapers $ pip install shub Collecting shub Downloading shub-2.7.0-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 615kB/s Requirement already satisfied: pip in /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg (from shub) Collecting tqdm (from shub) Downloading tqdm-4.19.5-py2.py3-none-any.whl (51kB) 100% |████████████████████████████████| 61kB 1.2MB/s Collecting retrying (from shub) Downloading retrying-1.3.3.tar.gz Collecting six>=1.7.0 (from shub) Downloading six-1.11.0-py2.py3-none-any.whl Collecting scrapinghub>=1.9.0 (from shub) Downloading scrapinghub-2.0.3-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 1.8MB/s Collecting requests (from shub) Downloading requests-2.18.4-py2.py3-none-any.whl (88kB) 100% |████████████████████████████████| 92kB 1.5MB/s Collecting click (from shub) Downloading click-6.7-py2.py3-none-any.whl (71kB) 100% |████████████████████████████████| 71kB 1.1MB/s Collecting docker-py (from shub) Downloading docker_py-1.10.6-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 2.9MB/s Collecting PyYAML (from shub) Downloading PyYAML-3.12.tar.gz (253kB) 100% |████████████████████████████████| 256kB 873kB/s Collecting certifi>=2017.4.17 (from requests->shub) Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB) 100% |████████████████████████████████| 153kB 854kB/s Collecting chardet<3.1.0,>=3.0.2 (from requests->shub) Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB) 100% |████████████████████████████████| 143kB 1.5MB/s Collecting idna<2.7,>=2.5 (from requests->shub) Downloading idna-2.6-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 2.2MB/s Collecting urllib3<1.23,>=1.21.1 (from requests->shub) Downloading urllib3-1.22-py2.py3-none-any.whl (132kB) 100% |████████████████████████████████| 133kB 1.7MB/s Collecting docker-pycreds>=0.2.1 (from docker-py->shub) Downloading docker_pycreds-0.2.1-py2.py3-none-any.whl Collecting backports.ssl-match-hostname>=3.5; python_version < "3.5" (from docker-py->shub) Downloading backports.ssl_match_hostname-3.5.0.1.tar.gz Collecting ipaddress>=1.0.16; python_version < "3.3" (from docker-py->shub) Downloading ipaddress-1.0.19.tar.gz Collecting websocket-client>=0.32.0 (from docker-py->shub) Downloading websocket_client-0.46.0-py2.py3-none-any.whl (200kB) 100% |████████████████████████████████| 204kB 1.8MB/s Installing collected packages: tqdm, six, retrying, certifi, chardet, idna, urllib3, requests, scrapinghub, click, docker-pycreds, backports.ssl-match-hostname, ipaddress, websocket-client, docker-py, PyYAML, shub Exception: Traceback (most recent call last): File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/commands/install.py", line 342, in run prefix=options.prefix_path, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_set.py", line 784, in install **kwargs File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 851, in install self.move_wheel_files(self.source_dir, root=root, prefix=prefix) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 1064, in move_wheel_files isolated=self.isolated, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/wheel.py", line 345, in move_wheel_files clobber(source, lib_dir, True) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/wheel.py", line 316, in clobber ensure_dir(destdir) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/utils/__init__.py", line 83, in ensure_dir os.makedirs(path) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/os.py", line 157, in makedirs mkdir(name, mode) OSError: [Errno 13] Permission denied: '/Library/Python/2.7/site-packages/tqdm-4.19.5.dist-info' johanna@Johannas-MBP Scrapers $ python Python 2.7.10 (default, Jul 15 2017, 17:16:57) [GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.31)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> exit() johanna@Johannas-MBP Scrapers $ pip install shub Collecting shub Using cached shub-2.7.0-py2.py3-none-any.whl Requirement already satisfied: pip in /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg (from shub) Collecting tqdm (from shub) Using cached tqdm-4.19.5-py2.py3-none-any.whl Collecting retrying (from shub) Using cached retrying-1.3.3.tar.gz Collecting six>=1.7.0 (from shub) Using cached six-1.11.0-py2.py3-none-any.whl Collecting scrapinghub>=1.9.0 (from shub) Using cached scrapinghub-2.0.3-py2.py3-none-any.whl Collecting requests (from shub) Using cached requests-2.18.4-py2.py3-none-any.whl Collecting click (from shub) Using cached click-6.7-py2.py3-none-any.whl Collecting docker-py (from shub) Using cached docker_py-1.10.6-py2.py3-none-any.whl Collecting PyYAML (from shub) Using cached PyYAML-3.12.tar.gz Collecting certifi>=2017.4.17 (from requests->shub) Using cached certifi-2018.1.18-py2.py3-none-any.whl Collecting chardet<3.1.0,>=3.0.2 (from requests->shub) Using cached chardet-3.0.4-py2.py3-none-any.whl Collecting idna<2.7,>=2.5 (from requests->shub) Using cached idna-2.6-py2.py3-none-any.whl Collecting urllib3<1.23,>=1.21.1 (from requests->shub) Using cached urllib3-1.22-py2.py3-none-any.whl Collecting docker-pycreds>=0.2.1 (from docker-py->shub) Downloading docker_pycreds-0.2.2-py2.py3-none-any.whl Collecting backports.ssl-match-hostname>=3.5; python_version < "3.5" (from docker-py->shub) Using cached backports.ssl_match_hostname-3.5.0.1.tar.gz Collecting ipaddress>=1.0.16; python_version < "3.3" (from docker-py->shub) Using cached ipaddress-1.0.19.tar.gz Collecting websocket-client>=0.32.0 (from docker-py->shub) Using cached websocket_client-0.46.0-py2.py3-none-any.whl Installing collected packages: tqdm, six, retrying, certifi, chardet, idna, urllib3, requests, scrapinghub, click, docker-pycreds, backports.ssl-match-hostname, ipaddress, websocket-client, docker-py, PyYAML, shub Exception: Traceback (most recent call last): File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/commands/install.py", line 342, in run prefix=options.prefix_path, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_set.py", line 784, in install **kwargs File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 851, in install self.move_wheel_files(self.source_dir, root=root, prefix=prefix) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 1064, in move_wheel_files isolated=self.isolated, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/wheel.py", line 345, in move_wheel_files clobber(source, lib_dir, True) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/wheel.py", line 316, in clobber ensure_dir(destdir) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/utils/__init__.py", line 83, in ensure_dir os.makedirs(path) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/os.py", line 157, in makedirs mkdir(name, mode) OSError: [Errno 13] Permission denied: '/Library/Python/2.7/site-packages/tqdm-4.19.5.dist-info' johanna@Johannas-MBP Scrapers $ sudo !! sudo pip install shub Password: The directory '/Users/johanna/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/Users/johanna/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting shub Downloading shub-2.7.0-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 2.4MB/s Requirement already satisfied: pip in /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg (from shub) Collecting tqdm (from shub) Downloading tqdm-4.19.5-py2.py3-none-any.whl (51kB) 100% |████████████████████████████████| 61kB 3.9MB/s Collecting retrying (from shub) Downloading retrying-1.3.3.tar.gz Collecting six>=1.7.0 (from shub) Downloading six-1.11.0-py2.py3-none-any.whl Collecting scrapinghub>=1.9.0 (from shub) Downloading scrapinghub-2.0.3-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 1.8MB/s Collecting requests (from shub) Downloading requests-2.18.4-py2.py3-none-any.whl (88kB) 100% |████████████████████████████████| 92kB 2.4MB/s Collecting click (from shub) Downloading click-6.7-py2.py3-none-any.whl (71kB) 100% |████████████████████████████████| 71kB 2.8MB/s Collecting docker-py (from shub) Downloading docker_py-1.10.6-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 3.6MB/s Collecting PyYAML (from shub) Downloading PyYAML-3.12.tar.gz (253kB) 100% |████████████████████████████████| 256kB 2.3MB/s Collecting certifi>=2017.4.17 (from requests->shub) Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB) 100% |████████████████████████████████| 153kB 2.6MB/s Collecting chardet<3.1.0,>=3.0.2 (from requests->shub) Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB) 100% |████████████████████████████████| 143kB 3.2MB/s Collecting idna<2.7,>=2.5 (from requests->shub) Downloading idna-2.6-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 4.0MB/s Collecting urllib3<1.23,>=1.21.1 (from requests->shub) Downloading urllib3-1.22-py2.py3-none-any.whl (132kB) 100% |████████████████████████████████| 133kB 3.6MB/s Collecting docker-pycreds>=0.2.1 (from docker-py->shub) Downloading docker_pycreds-0.2.2-py2.py3-none-any.whl Collecting backports.ssl-match-hostname>=3.5; python_version < "3.5" (from docker-py->shub) Downloading backports.ssl_match_hostname-3.5.0.1.tar.gz Collecting ipaddress>=1.0.16; python_version < "3.3" (from docker-py->shub) Downloading ipaddress-1.0.19.tar.gz Collecting websocket-client>=0.32.0 (from docker-py->shub) Downloading websocket_client-0.46.0-py2.py3-none-any.whl (200kB) 100% |████████████████████████████████| 204kB 2.7MB/s Installing collected packages: tqdm, six, retrying, certifi, chardet, idna, urllib3, requests, scrapinghub, click, docker-pycreds, backports.ssl-match-hostname, ipaddress, websocket-client, docker-py, PyYAML, shub Exception: Traceback (most recent call last): File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/commands/install.py", line 342, in run prefix=options.prefix_path, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_set.py", line 784, in install **kwargs File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 851, in install self.move_wheel_files(self.source_dir, root=root, prefix=prefix) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 1064, in move_wheel_files isolated=self.isolated, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/wheel.py", line 377, in move_wheel_files clobber(source, dest, False, fixer=fixer, filter=filter) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/wheel.py", line 316, in clobber ensure_dir(destdir) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/utils/__init__.py", line 83, in ensure_dir os.makedirs(path) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/os.py", line 150, in makedirs makedirs(head, mode) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/os.py", line 157, in makedirs mkdir(name, mode) OSError: [Errno 1] Operation not permitted: '/System/Library/Frameworks/Python.framework/Versions/2.7/man' johanna@Johannas-MBP Scrapers $ python3 Python 3.6.4 (v3.6.4:d48ecebad5, Dec 18 2017, 21:07:28) [GCC 4.2.1 (Apple Inc. build 5666) (dot 3)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> exit() johanna@Johannas-MBP Scrapers $ python Python 2.7.10 (default, Jul 15 2017, 17:16:57) [GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.31)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> exit() johanna@Johannas-MBP Scrapers $ echo $PATH /Applications/mamp/bin/php5.6.25/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin johanna@Johannas-MBP Scrapers $ sudo pip install shub Password: The directory '/Users/johanna/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/Users/johanna/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting shub Downloading shub-2.7.0-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 2.3MB/s Requirement already satisfied: pip in /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg (from shub) Requirement already satisfied: tqdm in /Library/Python/2.7/site-packages (from shub) Collecting retrying (from shub) Downloading retrying-1.3.3.tar.gz Collecting six>=1.7.0 (from shub) Downloading six-1.11.0-py2.py3-none-any.whl Collecting scrapinghub>=1.9.0 (from shub) Downloading scrapinghub-2.0.3-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 2.5MB/s Collecting requests (from shub) Downloading requests-2.18.4-py2.py3-none-any.whl (88kB) 100% |████████████████████████████████| 92kB 3.5MB/s Collecting click (from shub) Downloading click-6.7-py2.py3-none-any.whl (71kB) 100% |████████████████████████████████| 71kB 3.4MB/s Collecting docker-py (from shub) Downloading docker_py-1.10.6-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 5.7MB/s Collecting PyYAML (from shub) Downloading PyYAML-3.12.tar.gz (253kB) 100% |████████████████████████████████| 256kB 2.7MB/s Collecting certifi>=2017.4.17 (from requests->shub) Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB) 100% |████████████████████████████████| 153kB 3.5MB/s Collecting chardet<3.1.0,>=3.0.2 (from requests->shub) Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB) 100% |████████████████████████████████| 143kB 4.4MB/s Collecting idna<2.7,>=2.5 (from requests->shub) Downloading idna-2.6-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 5.8MB/s Collecting urllib3<1.23,>=1.21.1 (from requests->shub) Downloading urllib3-1.22-py2.py3-none-any.whl (132kB) 100% |████████████████████████████████| 133kB 5.4MB/s Collecting docker-pycreds>=0.2.1 (from docker-py->shub) Downloading docker_pycreds-0.2.2-py2.py3-none-any.whl Collecting backports.ssl-match-hostname>=3.5; python_version < "3.5" (from docker-py->shub) Downloading backports.ssl_match_hostname-3.5.0.1.tar.gz Collecting ipaddress>=1.0.16; python_version < "3.3" (from docker-py->shub) Downloading ipaddress-1.0.19.tar.gz Collecting websocket-client>=0.32.0 (from docker-py->shub) Downloading websocket_client-0.46.0-py2.py3-none-any.whl (200kB) 100% |████████████████████████████████| 204kB 2.6MB/s Installing collected packages: six, retrying, certifi, chardet, idna, urllib3, requests, scrapinghub, click, docker-pycreds, backports.ssl-match-hostname, ipaddress, websocket-client, docker-py, PyYAML, shub Found existing installation: six 1.4.1 DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project. Uninstalling six-1.4.1: Exception: Traceback (most recent call last): File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/commands/install.py", line 342, in run prefix=options.prefix_path, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_set.py", line 778, in install requirement.uninstall(auto_confirm=True) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 754, in uninstall paths_to_remove.remove(auto_confirm) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_uninstall.py", line 115, in remove renames(path, new_path) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/utils/__init__.py", line 267, in renames shutil.move(old, new) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 302, in move copy2(src, real_dst) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 131, in copy2 copystat(src, dst) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 103, in copystat os.chflags(dst, st.st_flags) OSError: [Errno 1] Operation not permitted: '/tmp/pip-gxz2Rw-uninstall/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/six-1.4.1-py2.7.egg-info' johanna@Johannas-MBP Scrapers $ sudo easy_install pip Searching for pip Best match: pip 9.0.1 Processing pip-9.0.1-py2.7.egg pip 9.0.1 is already the active version in easy-install.pth Installing pip script to /usr/local/bin Installing pip2.7 script to /usr/local/bin Installing pip2 script to /usr/local/bin Using /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg Processing dependencies for pip Finished processing dependencies for pip johanna@Johannas-MBP Scrapers $ pip Usage: pip [options] Commands: install Install packages. download Download packages. uninstall Uninstall packages. freeze Output installed packages in requirements format. list List installed packages. show Show information about installed packages. check Verify installed packages have compatible dependencies. search Search PyPI for packages. wheel Build wheels from your requirements. hash Compute hashes of package archives. completion A helper command used for command completion. help Show help for commands. General Options: -h, --help Show help. --isolated Run pip in an isolated mode, ignoring environment variables and user configuration. -v, --verbose Give more output. Option is additive, and can be used up to 3 times. -V, --version Show version and exit. -q, --quiet Give less output. Option is additive, and can be used up to 3 times (corresponding to WARNING, ERROR, and CRITICAL logging levels). --log Path to a verbose appending log. --proxy Specify a proxy in the form [user:passwd@]proxy.server:port. --retries Maximum number of retries each connection should attempt (default 5 times). --timeout Set the socket timeout (default 15 seconds). --exists-action Default action when a path already exists: (s)witch, (i)gnore, (w)ipe, (b)ackup, (a)bort. --trusted-host Mark this host as trusted, even though it does not have valid or any HTTPS. --cert Path to alternate CA bundle. --client-cert Path to SSL client certificate, a single file containing the private key and the certificate in PEM format. --cache-dir Store the cache data in . --no-cache-dir Disable the cache. --disable-pip-version-check Don't periodically check PyPI to determine whether a new version of pip is available for download. Implied with --no-index. johanna@Johannas-MBP Scrapers $ python 3 pip install shub python: can't open file '3': [Errno 2] No such file or directory johanna@Johannas-MBP Scrapers $ python3 pip install shub /Library/Frameworks/Python.framework/Versions/3.6/Resources/Python.app/Contents/MacOS/Python: can't open file 'pip': [Errno 2] No such file or directory johanna@Johannas-MBP Scrapers $ sudo python3 ~/get-pip.py Password: /Library/Frameworks/Python.framework/Versions/3.6/Resources/Python.app/Contents/MacOS/Python: can't open file '/Users/johanna/get-pip.py': [Errno 2] No such file or directory johanna@Johannas-MBP Scrapers $ sudo python3 ~/Downloads/get-pip.py The directory '/Users/johanna/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/Users/johanna/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Requirement already up-to-date: pip in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages Collecting wheel Downloading wheel-0.30.0-py2.py3-none-any.whl (49kB) 100% |████████████████████████████████| 51kB 3.2MB/s Installing collected packages: wheel Successfully installed wheel-0.30.0 johanna@Johannas-MBP Scrapers $ sudo pip install shub The directory '/Users/johanna/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. The directory '/Users/johanna/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Collecting shub Downloading shub-2.7.0-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 2.7MB/s Requirement already satisfied: pip in /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg (from shub) Requirement already satisfied: tqdm in /Library/Python/2.7/site-packages (from shub) Collecting retrying (from shub) Downloading retrying-1.3.3.tar.gz Collecting six>=1.7.0 (from shub) Downloading six-1.11.0-py2.py3-none-any.whl Collecting scrapinghub>=1.9.0 (from shub) Downloading scrapinghub-2.0.3-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 3.3MB/s Collecting requests (from shub) Downloading requests-2.18.4-py2.py3-none-any.whl (88kB) 100% |████████████████████████████████| 92kB 3.3MB/s Collecting click (from shub) Downloading click-6.7-py2.py3-none-any.whl (71kB) 100% |████████████████████████████████| 71kB 4.6MB/s Collecting docker-py (from shub) Downloading docker_py-1.10.6-py2.py3-none-any.whl (50kB) 100% |████████████████████████████████| 51kB 3.9MB/s Collecting PyYAML (from shub) Downloading PyYAML-3.12.tar.gz (253kB) 100% |████████████████████████████████| 256kB 2.5MB/s Collecting certifi>=2017.4.17 (from requests->shub) Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB) 100% |████████████████████████████████| 153kB 4.1MB/s Collecting chardet<3.1.0,>=3.0.2 (from requests->shub) Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB) 100% |████████████████████████████████| 143kB 3.0MB/s Collecting idna<2.7,>=2.5 (from requests->shub) Downloading idna-2.6-py2.py3-none-any.whl (56kB) 100% |████████████████████████████████| 61kB 2.9MB/s Collecting urllib3<1.23,>=1.21.1 (from requests->shub) Downloading urllib3-1.22-py2.py3-none-any.whl (132kB) 100% |████████████████████████████████| 133kB 3.5MB/s Collecting docker-pycreds>=0.2.1 (from docker-py->shub) Downloading docker_pycreds-0.2.2-py2.py3-none-any.whl Collecting backports.ssl-match-hostname>=3.5; python_version < "3.5" (from docker-py->shub) Downloading backports.ssl_match_hostname-3.5.0.1.tar.gz Collecting ipaddress>=1.0.16; python_version < "3.3" (from docker-py->shub) Downloading ipaddress-1.0.19.tar.gz Collecting websocket-client>=0.32.0 (from docker-py->shub) Downloading websocket_client-0.46.0-py2.py3-none-any.whl (200kB) 100% |████████████████████████████████| 204kB 3.3MB/s Installing collected packages: six, retrying, certifi, chardet, idna, urllib3, requests, scrapinghub, click, docker-pycreds, backports.ssl-match-hostname, ipaddress, websocket-client, docker-py, PyYAML, shub Found existing installation: six 1.4.1 DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project. Uninstalling six-1.4.1: Exception: Traceback (most recent call last): File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/commands/install.py", line 342, in run prefix=options.prefix_path, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_set.py", line 778, in install requirement.uninstall(auto_confirm=True) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 754, in uninstall paths_to_remove.remove(auto_confirm) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_uninstall.py", line 115, in remove renames(path, new_path) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/utils/__init__.py", line 267, in renames shutil.move(old, new) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 302, in move copy2(src, real_dst) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 131, in copy2 copystat(src, dst) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 103, in copystat os.chflags(dst, st.st_flags) OSError: [Errno 1] Operation not permitted: '/tmp/pip-qkYbDB-uninstall/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/six-1.4.1-py2.7.egg-info' johanna@Johannas-MBP Scrapers $ pip install shub Collecting shub Using cached shub-2.7.0-py2.py3-none-any.whl Requirement already satisfied: pip in /Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg (from shub) Requirement already satisfied: tqdm in /Library/Python/2.7/site-packages (from shub) Collecting retrying (from shub) Using cached retrying-1.3.3.tar.gz Collecting six>=1.7.0 (from shub) Using cached six-1.11.0-py2.py3-none-any.whl Collecting scrapinghub>=1.9.0 (from shub) Using cached scrapinghub-2.0.3-py2.py3-none-any.whl Collecting requests (from shub) Using cached requests-2.18.4-py2.py3-none-any.whl Collecting click (from shub) Using cached click-6.7-py2.py3-none-any.whl Collecting docker-py (from shub) Using cached docker_py-1.10.6-py2.py3-none-any.whl Collecting PyYAML (from shub) Using cached PyYAML-3.12.tar.gz Collecting certifi>=2017.4.17 (from requests->shub) Using cached certifi-2018.1.18-py2.py3-none-any.whl Collecting chardet<3.1.0,>=3.0.2 (from requests->shub) Using cached chardet-3.0.4-py2.py3-none-any.whl Collecting idna<2.7,>=2.5 (from requests->shub) Using cached idna-2.6-py2.py3-none-any.whl Collecting urllib3<1.23,>=1.21.1 (from requests->shub) Using cached urllib3-1.22-py2.py3-none-any.whl Collecting docker-pycreds>=0.2.1 (from docker-py->shub) Using cached docker_pycreds-0.2.2-py2.py3-none-any.whl Collecting backports.ssl-match-hostname>=3.5; python_version < "3.5" (from docker-py->shub) Using cached backports.ssl_match_hostname-3.5.0.1.tar.gz Collecting ipaddress>=1.0.16; python_version < "3.3" (from docker-py->shub) Using cached ipaddress-1.0.19.tar.gz Collecting websocket-client>=0.32.0 (from docker-py->shub) Using cached websocket_client-0.46.0-py2.py3-none-any.whl Installing collected packages: six, retrying, certifi, chardet, idna, urllib3, requests, scrapinghub, click, docker-pycreds, backports.ssl-match-hostname, ipaddress, websocket-client, docker-py, PyYAML, shub Found existing installation: six 1.4.1 DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project. Uninstalling six-1.4.1: Exception: Traceback (most recent call last): File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/basecommand.py", line 215, in main status = self.run(options, args) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/commands/install.py", line 342, in run prefix=options.prefix_path, File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_set.py", line 778, in install requirement.uninstall(auto_confirm=True) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 754, in uninstall paths_to_remove.remove(auto_confirm) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_uninstall.py", line 115, in remove renames(path, new_path) File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/utils/__init__.py", line 267, in renames shutil.move(old, new) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 302, in move copy2(src, real_dst) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 131, in copy2 copystat(src, dst) File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 103, in copystat os.chflags(dst, st.st_flags) OSError: [Errno 1] Operation not permitted: '/var/folders/_4/jdfdlxn96t5brn4r08x1y7040000gn/T/pip-gnkse8-uninstall/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/six-1.4.1-py2.7.egg-info' johanna@Johannas-MBP Scrapers $ pip3 install shub Collecting shub Using cached shub-2.7.0-py2.py3-none-any.whl Collecting requests (from shub) Using cached requests-2.18.4-py2.py3-none-any.whl Collecting retrying (from shub) Using cached retrying-1.3.3.tar.gz Collecting scrapinghub>=1.9.0 (from shub) Using cached scrapinghub-2.0.3-py2.py3-none-any.whl Collecting click (from shub) Using cached click-6.7-py2.py3-none-any.whl Collecting PyYAML (from shub) Using cached PyYAML-3.12.tar.gz Collecting tqdm (from shub) Using cached tqdm-4.19.5-py2.py3-none-any.whl Collecting six>=1.7.0 (from shub) Using cached six-1.11.0-py2.py3-none-any.whl Requirement already satisfied: pip in /Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages (from shub) Collecting docker-py (from shub) Using cached docker_py-1.10.6-py2.py3-none-any.whl Collecting idna<2.7,>=2.5 (from requests->shub) Using cached idna-2.6-py2.py3-none-any.whl Collecting chardet<3.1.0,>=3.0.2 (from requests->shub) Using cached chardet-3.0.4-py2.py3-none-any.whl Collecting urllib3<1.23,>=1.21.1 (from requests->shub) Using cached urllib3-1.22-py2.py3-none-any.whl Collecting certifi>=2017.4.17 (from requests->shub) Using cached certifi-2018.1.18-py2.py3-none-any.whl Collecting websocket-client>=0.32.0 (from docker-py->shub) Using cached websocket_client-0.46.0-py2.py3-none-any.whl Collecting docker-pycreds>=0.2.1 (from docker-py->shub) Using cached docker_pycreds-0.2.2-py2.py3-none-any.whl Building wheels for collected packages: retrying, PyYAML Running setup.py bdist_wheel for retrying ... done Stored in directory: /Users/johanna/Library/Caches/pip/wheels/d9/08/aa/49f7c109140006ea08a7657640aee3feafb65005bcd5280679 Running setup.py bdist_wheel for PyYAML ... done Stored in directory: /Users/johanna/Library/Caches/pip/wheels/2c/f7/79/13f3a12cd723892437c0cfbde1230ab4d82947ff7b3839a4fc Successfully built retrying PyYAML Installing collected packages: idna, chardet, urllib3, certifi, requests, six, retrying, scrapinghub, click, PyYAML, tqdm, websocket-client, docker-pycreds, docker-py, shub Successfully installed PyYAML-3.12 certifi-2018.1.18 chardet-3.0.4 click-6.7 docker-py-1.10.6 docker-pycreds-0.2.2 idna-2.6 requests-2.18.4 retrying-1.3.3 scrapinghub-2.0.3 shub-2.7.0 six-1.11.0 tqdm-4.19.5 urllib3-1.22 websocket-client-0.46.0 johanna@Johannas-MBP Scrapers $ ls -la total 0 drwxr-xr-x 2 johanna staff 64 Feb 14 13:30 . drwxr-xr-x 4 johanna staff 128 Feb 14 13:33 .. johanna@Johannas-MBP Scrapers $ git clone https://github.com/scrapy/booksbot.git Cloning into 'booksbot'... remote: Counting objects: 24, done. remote: Total 24 (delta 0), reused 0 (delta 0), pack-reused 24 Unpacking objects: 100% (24/24), done. johanna@Johannas-MBP Scrapers $ cd booksbot johanna@Johannas-MBP booksbot (master)$ shub login -bash: shub: command not found johanna@Johannas-MBP booksbot (master)$ python3 shub login /Library/Frameworks/Python.framework/Versions/3.6/Resources/Python.app/Contents/MacOS/Python: can't open file 'shub': [Errno 2] No such file or directory johanna@Johannas-MBP booksbot (master)$ pip3 shub login ERROR: unknown command "shub" johanna@Johannas-MBP booksbot (master)$