Recent Posts

Pages: 1 ... 4 5 [6] 7 8 ... 10

AIXTOOLS / error messages while installing aixtools-gettext

« Last post by tmcgivern on July 13, 2020, 03:13:59 PM »

installp: APPLYING software for:
aixtools.gnu.gettext.share 0.19.8.1
aixtools.gnu.gettext.rte 0.19.8.1
aixtools.gnu.gettext.man.en_US 0.19.8.1

sysck: 3001-036 WARNING: File /opt/lib/charset.alias
is also owned by fileset aixtools.gnu.libiconv.rte.
strip: *o -- 0654-400 Cannot open file.
No such file or directory
ar: No such file or directory
ar: 0707-117 The fopen system call failed on file *o.
strip: *o -- 0654-400 Cannot open file.
No such file or directory
ar: No such file or directory
ar: 0707-117 The fopen system call failed on file *.o.
Filesets processed: 9 of 13 (Total time: 11 secs).

this was while trying to install gnupg
in the end, it appears gnupg works (at least basic commands I tested work).

Do these errors look like they can be ignored?
is there further information you need to help you identify the source of the issue?

AIXTOOLS / Re: Python and wheels continuing story

« Last post by raghugr on July 06, 2020, 10:58:47 PM »

Thanks Michael. I am really not sure about the porting stuff since I am still new to this AIX. May be if there are few steps then I can try as long as I have some root access haha

AIXTOOLS / Re: Python and wheels continuing story

« Last post by Michael on July 06, 2020, 06:38:11 AM »

Thank you for the feedback.
I am nearly there.
Sadly, xlc does not support a ALL of syntax (that is quite common these days, C++11 standard).
As I went through my records I was surprised to see the last time I built pandas was Oct. 2016 (v0.19.0).
I am glad to hear you have it installed. Is it "portable" to another system? I ask, because one of the reasons I started "aixtools" was because I did not like (read did not condone) needing to run "make install" aka "python setup.py install" to get something extra installed - and then there is version management and/or uninstall.
FYI: I am going to continue looking into this. I'll post when I have a real "wheel" based solution.

AIXTOOLS / Re: Python and wheels continuing story

« Last post by raghugr on July 05, 2020, 06:16:01 PM »

Thank you very much Michael for supporting me through this. It was so encouraging to get a backing

.

I was able to install the pandas finally after at least 4-5 days. I believe these are the AIX toolbox packages I had sorted, may be it will help you to setup one for aixtools as well,

libstdc++-8.3.0-2.ppc
libstdc++-devel-8.3.0-2.ppc
libgomp-8.3.0-2.ppc
libgfortran-8.3.0-2.ppc
gcc-8.3.0-2.ppc
gcc-gfortran-8.3.0-2.ppc
libgcc-8.3.0-2.ppc
gcc-cpp-8.3.0-2.ppc
gcc-c++-8.3.0-2.ppc
openblas-0.3.6-1.ppc
lapack-3.8.0-1.ppc
blas-3.8.0-1.ppc
lapack-devel-3.8.0-1.ppc
python3-devel-3.7.6-1.ppc

Thank you again!

AIXTOOLS / Re: Python and wheels continuing story

« Last post by Michael on July 04, 2020, 03:52:49 PM »

Ran into an issue with pandas-1.0.5 and cython integration.
Testing 0.24.2 and 0.25.3 to see if the issue was also there - or more recent.

AIXTOOLS / Re: Python and wheels continuing story

« Last post by Michael on July 04, 2020, 10:08:11 AM »

Do you have a additional test machine? Or create a wpar that "copies" your /opt (rather than a namefs mount).
On that wpar - install my package of Python. I have packaged it in a way that it should co-exist with the AIX Toolbox version - just need to prefix your PATH with /opt/bin.
I am surprised about pip "breaking" as it is pure-Python.
It does not find "PackageFinder", which it seems is an internal package of setuptools and perhaps of pip internal code:root@x070:[/opt/lib]find . -name \*.py | xargs grep -i packagefind ./python3.7/site-packages/distlib/locators.py: as pip's PackageFinder, which works in an analogous fashion. ./python3.7/site-packages/pip/_internal/build_env.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/build_env.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/cli/req_command.py:needing download / PackageFinder capability don't unnecessarily import the ./python3.7/site-packages/pip/_internal/cli/req_command.py:PackageFinder machinery and all its vendored dependencies, etc. ./python3.7/site-packages/pip/_internal/cli/req_command.py:from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/cli/req_command.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/cli/req_command.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/cli/req_command.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/cli/req_command.py: # type: (PackageFinder) -> None ./python3.7/site-packages/pip/_internal/cli/req_command.py: # type: (...) -> PackageFinder ./python3.7/site-packages/pip/_internal/cli/req_command.py: return PackageFinder.create( ./python3.7/site-packages/pip/_internal/commands/list.py:from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/commands/list.py: return PackageFinder.create( ./python3.7/site-packages/pip/_internal/distributions/base.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/distributions/base.py: # type: (PackageFinder, bool) -> None ./python3.7/site-packages/pip/_internal/distributions/installed.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/distributions/installed.py: # type: (PackageFinder, bool) -> None ./python3.7/site-packages/pip/_internal/distributions/sdist.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/distributions/sdist.py: # type: (PackageFinder, bool) -> None ./python3.7/site-packages/pip/_internal/distributions/sdist.py: # type: (PackageFinder) -> None ./python3.7/site-packages/pip/_internal/distributions/wheel.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/distributions/wheel.py: # type: (PackageFinder, bool) -> None ./python3.7/site-packages/pip/_internal/index/package_finder.py:__all__ = ['FormatControl', 'BestCandidateResult', 'PackageFinder'] ./python3.7/site-packages/pip/_internal/index/package_finder.py: """A collection of candidates, returned by `PackageFinder.find_best_candidate`. ./python3.7/site-packages/pip/_internal/index/package_finder.py:class PackageFinder(object): ./python3.7/site-packages/pip/_internal/index/package_finder.py: # type: (...) -> PackageFinder ./python3.7/site-packages/pip/_internal/index/package_finder.py: """Create a PackageFinder. ./python3.7/site-packages/pip/_internal/network/session.py: # configured on this PackageFinder instance. ./python3.7/site-packages/pip/_internal/operations/prepare.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/operations/prepare.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/operations/prepare.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/req/req_file.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/req/req_file.py: finder=None, # type: Optional[PackageFinder] ./python3.7/site-packages/pip/_internal/req/req_file.py: :param finder: Instance of pip.index.PackageFinder. ./python3.7/site-packages/pip/_internal/req/req_file.py: finder=None, # type: Optional[PackageFinder] ./python3.7/site-packages/pip/_internal/req/req_file.py: finder=None, # type: Optional[PackageFinder] ./python3.7/site-packages/pip/_internal/req/req_file.py: # type: (Optional[PackageFinder]) -> LineParser ./python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/resolution/resolvelib/factory.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/resolution/resolvelib/factory.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/resolution/resolvelib/requirements.py: # We can safely always allow prereleases here since PackageFinder ./python3.7/site-packages/pip/_internal/resolution/resolvelib/requirements.py: # We can safely always allow prereleases here since PackageFinder ./python3.7/site-packages/pip/_internal/resolution/resolvelib/resolver.py: from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/resolution/resolvelib/resolver.py: finder, # type: PackageFinder ./python3.7/site-packages/pip/_internal/self_outdated_check.py:from pip._internal.index.package_finder import PackageFinder ./python3.7/site-packages/pip/_internal/self_outdated_check.py: # Lets use PackageFinder to see what the latest pip version is ./python3.7/site-packages/pip/_internal/self_outdated_check.py: finder = PackageFinder.create( ./python3.7/site-packages/pip/_vendor/distlib/locators.py: as pip's PackageFinder, which works in an analogous fashion. ./python3.7/site-packages/setuptools/__init__.py:class PackageFinder: ./python3.7/site-packages/setuptools/__init__.py:class PEP420PackageFinder(PackageFinder): ./python3.7/site-packages/setuptools/__init__.py:find_packages = PackageFinder.find ./python3.7/site-packages/setuptools/__init__.py: find_namespace_packages = PEP420PackageFinder.find
Again, using the WPAR approach - you could try to force re-install python3 from the AIX Toolbox (which will downgrade your installed pip, and then try "pip3 download pip", and then use the downloaded pip to upgrade your system.
Or, try downloading pip, and from the unpacked directory, use -

Code: [Select]

python(3) setup.py install

AIXTOOLS / Re: Python and wheels continuing story

« Last post by raghugr on July 04, 2020, 04:02:57 AM »

Thank you again Michael for your time and efforts on this.

I am sorry when my Admin specified aixtools I thought it was from yours. I am wrong, he had meant the aixtools folder from IBM FTP. So finally I got it to work. This was all the files needed gcc, gcc-c++,gcc-gfortran,openblas,lapack,python3-devel

However, somehow pip got corrupted and unable to fix this. Below is the report I am receiving when I am issuing a 'pip debug'

pip debug
Traceback (most recent call last):
File "/opt/freeware/bin/pip", line 11, in <module>
load_entry_point('pip==20.1.1', 'console_scripts', 'pip')()
File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 489, in load_entry_point
return get_distribution(dist).load_entry_point(group, name)
File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 2852, in load_entry_point
return ep.load()
File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 2443, in load
return self.resolve()
File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 2449, in resolve
module = __import__(self.module_name, fromlist=['__name__'], level=0)
File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/__init__.py", line 40, in <module>
from pip._internal.cli.autocompletion import autocomplete
File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/cli/autocompletion.py", line 8, in <module>
from pip._internal.cli.main_parser import create_main_parser
File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/cli/main_parser.py", line 11, in <module>
from pip._internal.commands import (
File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/commands/__init__.py", line 6, in <module>
from pip._internal.commands.completion import CompletionCommand
File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/commands/completion.py", line 6, in <module>
from pip._internal.cli.base_command import Command
File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 26, in <module>
from pip._internal.index import PackageFinder
ImportError: cannot import name 'PackageFinder' from 'pip._internal.index' (/opt/freeware/lib/python3.7/site-packages/pip/_internal/index/__init__.py)

Because of this I had to resort to 'easy_install' for both numpy and Pandas. It was successful. Any suggestions you wish to provide for fixing the pip? I tried to install pip via easy_install but that did not work either.

Once again thank you for your time and efforts on this

AIXTOOLS / Re: Python and wheels continuing story

« Last post by Michael on July 03, 2020, 03:57:04 PM »

Actually, the only package I built myself is lapack - as a static library.
bos.adt.libm contains the IBM provided libblas.a - and I try to get it to use that.
and for compilers, I have my own v11 vac(pp) compiler, and I use the "try and buy" xlf (15.2) compiler for the fortran bits.
Results:
With a 32-bit build
numpy-1.19.0 runtests.py finishes with:87 failed, 10629 passed, 94 skipped, 108 deselected, 21 xfailed, 78 errors

Ah - so you are looking for pandas - I have done that before.
But since you mention gcc and gcc-fortran - I suspect you are using the AIX Toolbox, or Perzl's packaging of python.
Try this:(py37) aixtools@x070:[/home/aixtools/python/download/numpy-1.19.0]pip debug WARNING: This command is only meant for debugging. Do not use this with automation for parsing and getting these details, since the output and options of this command may change without notice. pip version: pip 20.1.1 from /opt/lib/python3.7/site-packages/pip (python 3.7) sys.version: 3.7.7 (default, Jul 3 2020, 06:10:55) [C] sys.executable: /opt/bin/python3.7 sys.getdefaultencoding: utf-8 sys.getfilesystemencoding: iso8859-1 locale.getpreferredencoding: ISO8859-1 sys.platform: aix6 sys.implementation: name: cpython 'cert' config value: Not specified REQUESTS_CA_BUNDLE: None CURL_CA_BUNDLE: None pip._vendor.certifi.where(): /opt/lib/python3.7/site-packages/pip/_vendor/certifi/cacert.pem pip._vendor.DEBUNDLED: False vendored library versions: appdirs==1.4.3 ... webencodings==0.5.1 (Unable to locate actual module version, using vendor.txt specified version) Compatible tags: 27 cp37-cp37m-aix_6106_1043_32 cp37-abi3-aix_6106_1043_32 cp37-none-aix_6106_1043_32 cp36-abi3-aix_6106_1043_32 cp35-abi3-aix_6106_1043_32 cp34-abi3-aix_6106_1043_32 cp33-abi3-aix_6106_1043_32 cp32-abi3-aix_6106_1043_32 py37-none-aix_6106_1043_32 py3-none-aix_6106_1043_32 ... [First 10 tags shown. Pass --verbose to show all.]
I am particularly curious about the tags you see - old, or new (as in New in Python3.9, and backported by me down to Python3.6).
If `pip debug` does not work, you need to update your pip.

AIXTOOLS / Re: Python and wheels continuing story

« Last post by raghugr on July 03, 2020, 11:06:11 AM »

Thanks Michael for your effort on this. Alternatively, you can also tell me the right list of packages so I ask our team to get it right as well. Some of them I see is,

openblas
gcc
gcc-c++
gcc-gfortran
lapack

Any other?

EDIT: After support prolonged support from our team, I was able to install numpy using easy_install at last.. Problem is not sure which has caused the resolution

.. between now trying to install pandas package and seeing some errors for missing gc++ I guess.. Hopefully, will sort it.. I will keep you posted if I learnt something on this

AIXTOOLS / Re: Python and wheels continuing story

« Last post by Michael on July 03, 2020, 06:56:14 AM »

OK. My update is that I am building a new build system. I need a clean system to reinstall the try and buy Fortran compiler.
Should have more news later today.

Pages: 1 ... 4 5 [6] 7 8 ... 10