pd.read_pickle, pd.DataFrame.to_pickle do not accept pathlib.Path objects #14932
Description
Code Sample
In [1]: import pandas as pd
...: import pathlib as pl
...: path = pl.Path.home() / 'tmp.pickle' # I have prepared a pickle in this path
...:
In [2]: df = pd.read_pickle(str(path)) # This works, no problem
...:
In [3]: df2 = pd.read_pickle(path) # This breaks
...:
---------------------------------------------------------------------------
TypeError Traceback (most recent call last)
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in try_read(path, encoding)
50 try:
---> 51 with open(path, 'rb') as fh:
52 return pkl.load(fh)
TypeError: invalid file: PosixPath('/home/ntaw/tmp.pickle')
During handling of the above exception, another exception occurred:
TypeError Traceback (most recent call last)
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in try_read(path, encoding)
55 try:
---> 56 with open(path, 'rb') as fh:
57 return pc.load(fh, encoding=encoding, compat=False)
TypeError: invalid file: PosixPath('/home/ntaw/tmp.pickle')
During handling of the above exception, another exception occurred:
TypeError Traceback (most recent call last)
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in read_pickle(path)
64 try:
---> 65 return try_read(path)
66 except:
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in try_read(path, encoding)
60 except:
---> 61 with open(path, 'rb') as fh:
62 return pc.load(fh, encoding=encoding, compat=True)
TypeError: invalid file: PosixPath('/home/ntaw/tmp.pickle')
During handling of the above exception, another exception occurred:
TypeError Traceback (most recent call last)
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in try_read(path, encoding)
50 try:
---> 51 with open(path, 'rb') as fh:
52 return pkl.load(fh)
TypeError: invalid file: PosixPath('/home/ntaw/tmp.pickle')
During handling of the above exception, another exception occurred:
TypeError Traceback (most recent call last)
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in try_read(path, encoding)
55 try:
---> 56 with open(path, 'rb') as fh:
57 return pc.load(fh, encoding=encoding, compat=False)
TypeError: invalid file: PosixPath('/home/ntaw/tmp.pickle')
During handling of the above exception, another exception occurred:
TypeError Traceback (most recent call last)
<ipython-input-3-d33de9a00518> in <module>()
----> 1 df2 = pd.read_pickle(path)
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in read_pickle(path)
66 except:
67 if PY3:
---> 68 return try_read(path, encoding='latin1')
69 raise
70
/home/ntaw/anaconda3/lib/python3.5/site-packages/pandas/io/pickle.py in try_read(path, encoding)
59 # compat pickle
60 except:
---> 61 with open(path, 'rb') as fh:
62 return pc.load(fh, encoding=encoding, compat=True)
63
TypeError: invalid file: PosixPath('/home/ntaw/tmp.pickle')Problem description
pandas breaks at df = pd.read_pickle(path). It seems to me that this should have been solved along with issue #11033, but it evidently doesn't work for my setup.
I encountered the same issue with pd.DataFrame.to_pickle.
The usecase appears to be related to open issue #14705 and closed pull request #12930.
Expected Output
I would expect the pandas.read_* functions and pandas.DataFrame.to_* methods to recognise pathlib objects, and handle the conversion str(path) under the hood.
Output of pd.show_versions()
pandas: 0.19.1
nose: 1.3.7
pip: 9.0.1
setuptools: 27.2.0
Cython: 0.25.1
numpy: 1.11.2
scipy: 0.18.1
statsmodels: 0.6.1
xarray: None
IPython: 5.1.0
sphinx: 1.4.8
patsy: 0.4.1
dateutil: 2.6.0
pytz: 2016.7
blosc: None
bottleneck: 1.1.0
tables: 3.3.0
numexpr: 2.6.1
matplotlib: 1.5.3
openpyxl: 2.4.0
xlrd: 1.0.0
xlwt: 1.1.2
xlsxwriter: 0.9.3
lxml: 3.6.4
bs4: 4.5.1
html5lib: None
httplib2: 0.9.2
apiclient: 1.5.1
sqlalchemy: 1.1.3
pymysql: None
psycopg2: None
jinja2: 2.8
boto: 2.43.0
pandas_datareader: None