Date: 13-08-20  Time: 02:02 AM

Recent Posts

Pages: [1] 2 3 ... 10
1
AIXTOOLS / Re: error messages while installing aixtools-gettext
« Last post by Michael on July 16, 2020, 06:03:29 AM »
AIX 7.1 TL5 took many of the run-time elements that AIX 7.2 has.

Actually, it is just one fileset we need concern ourselves with - rpm.rte.
The main point: the message re: missing .o files is accurate - and your assumption about being harmless message is correct as the .o files are no longer in the libintl.a file shipped with rpm.rte.
2
AIXTOOLS / Re: error messages while installing aixtools-gettext
« Last post by tmcgivern on July 15, 2020, 03:25:38 PM »
all our systems are at 7100-05-04-1914
sorry I'm trying to find a system I can work with to analyze what you list above
3
AIXTOOLS / Re: error messages while installing aixtools-gettext
« Last post by Michael on July 14, 2020, 05:58:04 AM »
Thanks for the report.
I'll check the scripts.
I would like to know your version of AIX.

Traditionally, the library libintl.a provided by AIX is 'ancient' (member: libintl.so.1, plus several .o members).
During installation of my version I make a copy of the original AIX files (name them libintl.a.AIX and for gnu.iconv libiconv.a.AIX) and merge the AIX libraries and my new 'aixtools' libraries (from /opt/lib) and put the merged versions in /usr/lib.
aixtools@x064:[/home/aixtools]cd /usr/lib/aixtools@x064:[/usr/lib]ls -l *AIX
-r--r--r--    1 bin      bin          788939 Aug 02 2018  libiconv.a.AIX
lrwxrwxrwx    1 root     system           31 Aug 02 2018  libintl.a.AIX -> /usr/opt/freeware/lib/libintl.a

aixtools@x064:[/usr/lib]ar tv /usr/opt/freeware/lib/libintl.a
rwxr-xr-x   203/1     114582 Jan 04 20:38 2008 libintl.so.1
rw-r--r--   203/1       6816 Jan 04 20:38 2008 intl-compat.o
rw-r--r--   203/1       7632 Jan 04 20:38 2008 bindtextdom.o
rw-r--r--   203/1       1840 Jan 04 20:38 2008 dcgettext.o
rw-r--r--   203/1       1768 Jan 04 20:38 2008 dgettext.o
rw-r--r--   203/1       1877 Jan 04 20:38 2008 gettext.o
rw-r--r--   203/1       5045 Jan 04 20:38 2008 finddomain.o
rw-r--r--   203/1      13339 Jan 04 20:38 2008 loadmsgcat.o
rw-r--r--   203/1       9525 Jan 04 20:38 2008 localealias.o
rw-r--r--   203/1       3005 Jan 04 20:38 2008 textdomain.o
rw-r--r--   203/1      10685 Jan 04 20:38 2008 l10nflist.o
rw-r--r--   203/1       5351 Jan 04 20:38 2008 explodename.o
rw-r--r--   203/1      23822 Jan 04 20:38 2008 dcigettext.o
rw-r--r--   203/1       1911 Jan 04 20:38 2008 dcngettext.o
rw-r--r--   203/1       1866 Jan 04 20:38 2008 dngettext.o
rw-r--r--   203/1       1979 Jan 04 20:38 2008 ngettext.o
rw-r--r--   203/1      15990 Jan 04 20:38 2008 plural.o
rw-r--r--   203/1       6503 Jan 04 20:38 2008 localcharset.o

Merged: Notice both libintl.so.8 and libintl.so.1 are included. The 'original' libintl.so.1 is maintained for the AIX programs (e.g., gzip) that depend on it. And, during the merge a flag in the .so and the .o files is modified so that they are only used by the run-time loader, but no longer by a compiler linker.

aixtools@x064:[/usr/lib]ar tv /usr/lib/libintl.a
rwxr-xr-x     0/0      79727 Aug 21 18:17 2016 libintl.so.8
rw-r--r--     0/0       7632 Aug 02 09:41 2018 bindtextdom.o
rw-r--r--     0/0       1840 Aug 02 09:41 2018 dcgettext.o
rw-r--r--     0/0      23822 Aug 02 09:41 2018 dcigettext.o
rw-r--r--     0/0       1911 Aug 02 09:41 2018 dcngettext.o
rw-r--r--     0/0       1768 Aug 02 09:41 2018 dgettext.o
rw-r--r--     0/0       1866 Aug 02 09:41 2018 dngettext.o
rw-r--r--     0/0       5351 Aug 02 09:41 2018 explodename.o
rw-r--r--     0/0       5045 Aug 02 09:41 2018 finddomain.o
rw-r--r--     0/0       1877 Aug 02 09:41 2018 gettext.o
rw-r--r--     0/0       6816 Aug 02 09:41 2018 intl-compat.o
rw-r--r--     0/0      10685 Aug 02 09:41 2018 l10nflist.o
rw-r--r--     0/0      13339 Aug 02 09:41 2018 loadmsgcat.o
rw-r--r--     0/0       6503 Aug 02 09:41 2018 localcharset.o
rw-r--r--     0/0       9525 Aug 02 09:41 2018 localealias.o
rw-r--r--     0/0       1979 Aug 02 09:41 2018 ngettext.o
rw-r--r--     0/0      15990 Aug 02 09:41 2018 plural.o
rw-r--r--     0/0       3005 Aug 02 09:41 2018 textdomain.o
rwxr-xr-x     0/0     114582 Aug 02 09:41 2018 libintl.so.1

My guess is that the latest version of 'freeware' (i.e., coming from RPM.rte) no longer has .o members, and so the script that expects them has error messages.
So, once I know your version of AIX - i'll make some adjustments to the packaging or both gnupg and gettext.
Michael

P.S.: just checked an AIX 7.2 system - seems the .o files are removed!
root@power8:[/export/power/aix]oslevel -s
7200-02-02-1810

root@power8:[/export/power/aix]ls -l /usr/lib/libintl.*
lrwxrwxrwx    1 root     system           31 Jul 05 2018  /usr/lib/libintl.a -> /usr/opt/freeware/lib/libintl.a

root@power8:[/export/power/aix]ar tv /usr/lib/libintl.a
rwxr-xr-x     0/0      86741 Jun 02 13:56 2016 libintl.so.8
rwxr-xr-x     0/0     114582 Apr 06 18:53 2017 libintl.so.1
4
AIXTOOLS / error messages while installing aixtools-gettext
« Last post by tmcgivern on July 13, 2020, 03:13:59 PM »
installp: APPLYING software for:
        aixtools.gnu.gettext.share 0.19.8.1
        aixtools.gnu.gettext.rte 0.19.8.1
        aixtools.gnu.gettext.man.en_US 0.19.8.1

sysck: 3001-036 WARNING:  File /opt/lib/charset.alias
        is also owned by fileset aixtools.gnu.libiconv.rte.
strip: *o -- 0654-400 Cannot open file.
        No such file or directory
ar: No such file or directory
ar: 0707-117 The fopen system call failed on file *o.
strip: *o -- 0654-400 Cannot open file.
        No such file or directory
ar: No such file or directory
ar: 0707-117 The fopen system call failed on file *.o.
Filesets processed:  9 of 13  (Total time:  11 secs).

this was while trying to install gnupg
in the end, it appears gnupg works (at least basic commands I tested work).

Do these errors look like they can be ignored?
is there further information you need to help you identify the source of the issue?
5
AIXTOOLS / Re: Python and wheels continuing story
« Last post by raghugr on July 06, 2020, 10:58:47 PM »
Thanks Michael. I am really not sure about the porting stuff since I am still new to this AIX. May be if there are few steps then I can try as long as I have some root access haha
6
AIXTOOLS / Re: Python and wheels continuing story
« Last post by Michael on July 06, 2020, 06:38:11 AM »
Thank you for the feedback.
I am nearly there.
Sadly, xlc does not support a ALL of syntax (that is quite common these days, C++11 standard).
As I went through my records I was surprised to see the last time I built pandas was Oct. 2016 (v0.19.0).
I am glad to hear you have it installed. Is it "portable" to another system? I ask, because one of the reasons I started "aixtools" was because I did not like (read did not condone) needing to run "make install" aka "python setup.py install" to get something extra installed - and then there is version management and/or uninstall.
FYI: I am going to continue looking into this. I'll post when I have a real "wheel" based solution.
7
AIXTOOLS / Re: Python and wheels continuing story
« Last post by raghugr on July 05, 2020, 06:16:01 PM »
Thank you very much Michael for supporting me through this. It was so encouraging to get a backing :).

I was able to install the pandas finally after at least 4-5 days. I believe these are the AIX toolbox packages I had sorted, may be it will help you to setup one for aixtools as well,

libstdc++-8.3.0-2.ppc
libstdc++-devel-8.3.0-2.ppc
libgomp-8.3.0-2.ppc
libgfortran-8.3.0-2.ppc
gcc-8.3.0-2.ppc
gcc-gfortran-8.3.0-2.ppc
libgcc-8.3.0-2.ppc
gcc-cpp-8.3.0-2.ppc
gcc-c++-8.3.0-2.ppc
openblas-0.3.6-1.ppc
lapack-3.8.0-1.ppc
blas-3.8.0-1.ppc
lapack-devel-3.8.0-1.ppc
python3-devel-3.7.6-1.ppc

Thank you again!
8
AIXTOOLS / Re: Python and wheels continuing story
« Last post by Michael on July 04, 2020, 03:52:49 PM »
Ran into an issue with pandas-1.0.5 and cython integration.
Testing 0.24.2 and 0.25.3 to see if the issue was also there - or more recent.
9
AIXTOOLS / Re: Python and wheels continuing story
« Last post by Michael on July 04, 2020, 10:08:11 AM »
Do you have a additional test machine? Or create a wpar that "copies" your /opt (rather than a namefs mount).
On that wpar - install my package of Python. I have packaged it in a way that it should co-exist with the AIX Toolbox version - just need to prefix your PATH with /opt/bin.
I am surprised about pip "breaking" as it is pure-Python.
It does not find "PackageFinder", which it seems is an internal package of setuptools and perhaps of pip internal code:
root@x070:[/opt/lib]find . -name \*.py | xargs grep -i packagefind
./python3.7/site-packages/distlib/locators.py:    as pip's PackageFinder, which works in an analogous fashion.
./python3.7/site-packages/pip/_internal/build_env.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/build_env.py:        finder,  # type: PackageFinder
./python3.7/site-packages/pip/_internal/cli/req_command.py:needing download / PackageFinder capability don't unnecessarily import the
./python3.7/site-packages/pip/_internal/cli/req_command.py:PackageFinder machinery and all its vendored dependencies, etc.
./python3.7/site-packages/pip/_internal/cli/req_command.py:from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/cli/req_command.py:        finder,                   # type: PackageFinder
./python3.7/site-packages/pip/_internal/cli/req_command.py:        finder,                              # type: PackageFinder
./python3.7/site-packages/pip/_internal/cli/req_command.py:        finder,           # type: PackageFinder
./python3.7/site-packages/pip/_internal/cli/req_command.py:        # type: (PackageFinder) -> None
./python3.7/site-packages/pip/_internal/cli/req_command.py:        # type: (...) -> PackageFinder
./python3.7/site-packages/pip/_internal/cli/req_command.py:        return PackageFinder.create(
./python3.7/site-packages/pip/_internal/commands/list.py:from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/commands/list.py:        return PackageFinder.create(
./python3.7/site-packages/pip/_internal/distributions/base.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/distributions/base.py:        # type: (PackageFinder, bool) -> None
./python3.7/site-packages/pip/_internal/distributions/installed.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/distributions/installed.py:        # type: (PackageFinder, bool) -> None
./python3.7/site-packages/pip/_internal/distributions/sdist.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/distributions/sdist.py:        # type: (PackageFinder, bool) -> None
./python3.7/site-packages/pip/_internal/distributions/sdist.py:        # type: (PackageFinder) -> None
./python3.7/site-packages/pip/_internal/distributions/wheel.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/distributions/wheel.py:        # type: (PackageFinder, bool) -> None
./python3.7/site-packages/pip/_internal/index/package_finder.py:__all__ = ['FormatControl', 'BestCandidateResult', 'PackageFinder']
./python3.7/site-packages/pip/_internal/index/package_finder.py:    """A collection of candidates, returned by `PackageFinder.find_best_candidate`.
./python3.7/site-packages/pip/_internal/index/package_finder.py:class PackageFinder(object):
./python3.7/site-packages/pip/_internal/index/package_finder.py:        # type: (...) -> PackageFinder
./python3.7/site-packages/pip/_internal/index/package_finder.py:        """Create a PackageFinder.
./python3.7/site-packages/pip/_internal/network/session.py:        # configured on this PackageFinder instance.
./python3.7/site-packages/pip/_internal/operations/prepare.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/operations/prepare.py:        finder,  # type: PackageFinder
./python3.7/site-packages/pip/_internal/operations/prepare.py:        finder,  # type: PackageFinder
./python3.7/site-packages/pip/_internal/req/req_file.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/req/req_file.py:    finder=None,  # type: Optional[PackageFinder]
./python3.7/site-packages/pip/_internal/req/req_file.py:    :param finder:      Instance of pip.index.PackageFinder.
./python3.7/site-packages/pip/_internal/req/req_file.py:    finder=None,  # type: Optional[PackageFinder]
./python3.7/site-packages/pip/_internal/req/req_file.py:    finder=None,  # type: Optional[PackageFinder]
./python3.7/site-packages/pip/_internal/req/req_file.py:    # type: (Optional[PackageFinder]) -> LineParser
./python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py:        finder,  # type: PackageFinder
./python3.7/site-packages/pip/_internal/resolution/resolvelib/factory.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/resolution/resolvelib/factory.py:        finder,  # type: PackageFinder
./python3.7/site-packages/pip/_internal/resolution/resolvelib/requirements.py:        # We can safely always allow prereleases here since PackageFinder
./python3.7/site-packages/pip/_internal/resolution/resolvelib/requirements.py:        # We can safely always allow prereleases here since PackageFinder
./python3.7/site-packages/pip/_internal/resolution/resolvelib/resolver.py:    from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/resolution/resolvelib/resolver.py:        finder,  # type: PackageFinder
./python3.7/site-packages/pip/_internal/self_outdated_check.py:from pip._internal.index.package_finder import PackageFinder
./python3.7/site-packages/pip/_internal/self_outdated_check.py:            # Lets use PackageFinder to see what the latest pip version is
./python3.7/site-packages/pip/_internal/self_outdated_check.py:            finder = PackageFinder.create(
./python3.7/site-packages/pip/_vendor/distlib/locators.py:    as pip's PackageFinder, which works in an analogous fashion.
./python3.7/site-packages/setuptools/__init__.py:class PackageFinder:
./python3.7/site-packages/setuptools/__init__.py:class PEP420PackageFinder(PackageFinder):
./python3.7/site-packages/setuptools/__init__.py:find_packages = PackageFinder.find
./python3.7/site-packages/setuptools/__init__.py:  find_namespace_packages = PEP420PackageFinder.find

Again, using the WPAR approach - you could try to force re-install python3 from the AIX Toolbox (which will downgrade your installed pip, and then try "pip3 download pip", and then use the downloaded pip to upgrade your system.
Or, try downloading pip, and from the unpacked directory, use -
Code: [Select]
python(3) setup.py install
10
AIXTOOLS / Re: Python and wheels continuing story
« Last post by raghugr on July 04, 2020, 04:02:57 AM »
Thank you again Michael for your time and efforts on this.

I am sorry when my Admin specified aixtools I thought it was from yours. I am wrong, he had meant the aixtools folder from IBM FTP. So finally I got it to work. This was all the files needed gcc, gcc-c++,gcc-gfortran,openblas,lapack,python3-devel

However, somehow pip got corrupted and unable to fix this. Below is the report I am receiving when I am issuing a 'pip debug'

pip debug
Traceback (most recent call last):
  File "/opt/freeware/bin/pip", line 11, in <module>
    load_entry_point('pip==20.1.1', 'console_scripts', 'pip')()
  File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 489, in load_entry_point
    return get_distribution(dist).load_entry_point(group, name)
  File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 2852, in load_entry_point
    return ep.load()
  File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 2443, in load
    return self.resolve()
  File "/opt/freeware/lib/python3.7/site-packages/pkg_resources/__init__.py", line 2449, in resolve
    module = __import__(self.module_name, fromlist=['__name__'], level=0)
  File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/__init__.py", line 40, in <module>
    from pip._internal.cli.autocompletion import autocomplete
  File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/cli/autocompletion.py", line 8, in <module>
    from pip._internal.cli.main_parser import create_main_parser
  File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/cli/main_parser.py", line 11, in <module>
    from pip._internal.commands import (
  File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/commands/__init__.py", line 6, in <module>
    from pip._internal.commands.completion import CompletionCommand
  File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/commands/completion.py", line 6, in <module>
    from pip._internal.cli.base_command import Command
  File "/opt/freeware/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 26, in <module>
    from pip._internal.index import PackageFinder
ImportError: cannot import name 'PackageFinder' from 'pip._internal.index' (/opt/freeware/lib/python3.7/site-packages/pip/_internal/index/__init__.py)


Because of this I had to resort to 'easy_install' for both numpy and Pandas. It was successful. Any suggestions you wish to provide for fixing the pip? I tried to install pip via easy_install but that did not work either.

Once again thank you for your time and efforts on this :)
Pages: [1] 2 3 ... 10