Date: 18-09-20  Time: 11:38 AM

Recent Posts

Pages: 1 ... 8 9 [10]
91
AIXTOOLS / Re: Python 3.8, ModuleNotFoundError: No module named '_sqlite3'
« Last post by Michael on March 31, 2020, 05:06:25 PM »
So, with the correct pep425 code patch pip3 debug says:
Code: [Select]
root@x065:[/data/prj/python/py38-3.8.2]pip3 debug
WARNING: This command is only meant for debugging. Do not use this with automation for parsing and getting these details, since the output and options of this command may change without notice.
pip version: pip 19.2.3 from /opt/lib/python3.8/site-packages/pip (python 3.
sys.version: 3.8.2 (default, Mar 31 2020, 16:07:53) [C]
sys.executable: /opt/bin/python3.8
sys.getdefaultencoding: utf-8
sys.getfilesystemencoding: iso8859-1
locale.getpreferredencoding: ISO8859-1
sys.platform: aix
sys.implementation:
  name: cpython
Compatible tags: 22
  cp38-cp38-aix_5307_0747_64
  cp38-abi3-aix_5307_0747_64
  cp38-none-aix_5307_0747_64
  cp37-abi3-aix_5307_0747_64
  cp36-abi3-aix_5307_0747_64
  cp35-abi3-aix_5307_0747_64
  cp34-abi3-aix_5307_0747_64
  cp33-abi3-aix_5307_0747_64
  cp32-abi3-aix_5307_0747_64
  py3-none-aix_5307_0747_64
Or something like that - as what you see depends on what your system is currently at!
92
AIXTOOLS / Re: Python 3.8, ModuleNotFoundError: No module named '_sqlite3'
« Last post by Michael on March 31, 2020, 10:19:26 AM »
The unpatched version (i.e., no wheel support) says:
pip version: pip 19.2.3 from /opt/lib/python3.8/site-packages/pip (python 3.8)
sys.version: 3.8.2 (default, Mar  6 2020, 17:40:06) [C]
sys.executable: /opt/bin/python3.8
sys.getdefaultencoding: utf-8
sys.getfilesystemencoding: iso8859-1
locale.getpreferredencoding: ISO8859-1
sys.platform: aix
sys.implementation:
  name: cpython
Compatible tags: 22
  cp38-cp38-aix_5_3
  cp38-abi3-aix_5_3
  cp38-none-aix_5_3
  cp37-abi3-aix_5_3
  cp36-abi3-aix_5_3
  cp35-abi3-aix_5_3
  cp34-abi3-aix_5_3
  cp33-abi3-aix_5_3
  cp32-abi3-aix_5_3
  py3-none-aix_5_3

So, I am going to add the PEP425 support that IS included in the Python3.9 release.
More soon.
93
AIXTOOLS / Re: Python 3.8, ModuleNotFoundError: No module named '_sqlite3'
« Last post by Michael on March 31, 2020, 09:55:54 AM »
No, nothing wrong on your side. Noone (before) has wanted sqllite. However, I have been building new versions.
I'll get a new version out asap - 3.8.2 iirc. And I'll have an additional patch installed so that you can work with wheels.
Note: I am changing the fileset name - to allow multiple versions to be installed.
aixtools.python.py3X (so in this case, would be aixtools.python.py38).
I'll try and have it refuse to install if aixtools.python3.* is already installed. but not sure if I'll have time to get that built-in today.
94
AIXTOOLS / Python 3.8, ModuleNotFoundError: No module named '_sqlite3'
« Last post by hammertime on March 30, 2020, 10:50:53 PM »
Apologies if I'm doing something silly here.  Trying to import some Python modules and getting the _sqlite3 error.  The first hits from a web search suggest that sqlite-devel would need to have been installed on the server where Python distribution was compiled.  Does this sound likely?

[ts01]:root:/root # pip3 list
Package    Version
---------- -------
nltk       3.4.5
pip        20.0.2
setuptools 46.1.3
six        1.14.0

[ts01]:root:/root # python3
Python 3.8.0 (default, Oct 26 2019, 17:53:18) [C] on aix
Type "help", "copyright", "credits" or "license" for more information.
>>> import nltk
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/lib/python3.8/site-packages/nltk/__init__.py", line 150, in <module>
    from nltk.translate import *
  File "/opt/lib/python3.8/site-packages/nltk/translate/__init__.py", line 23, in <module>
    from nltk.translate.meteor_score import meteor_score as meteor
  File "/opt/lib/python3.8/site-packages/nltk/translate/meteor_score.py", line 10, in <module>
    from nltk.stem.porter import PorterStemmer
  File "/opt/lib/python3.8/site-packages/nltk/stem/__init__.py", line 29, in <module>
    from nltk.stem.snowball import SnowballStemmer
  File "/opt/lib/python3.8/site-packages/nltk/stem/snowball.py", line 32, in <module>
    from nltk.corpus import stopwords
  File "/opt/lib/python3.8/site-packages/nltk/corpus/__init__.py", line 66, in <module>
    from nltk.corpus.reader import *
  File "/opt/lib/python3.8/site-packages/nltk/corpus/reader/__init__.py", line 105, in <module>
    from nltk.corpus.reader.panlex_lite import *
  File "/opt/lib/python3.8/site-packages/nltk/corpus/reader/panlex_lite.py", line 15, in <module>
    import sqlite3
  File "/opt/lib/python3.8/sqlite3/__init__.py", line 23, in <module>
    from sqlite3.dbapi2 import *
  File "/opt/lib/python3.8/sqlite3/dbapi2.py", line 27, in <module>
    from _sqlite3 import *
ModuleNotFoundError: No module named '_sqlite3'
>>>

[ts01]:root:/root # lslpp -L |grep python3
  aixtools.python3.adt       3.8.0.0    C     F    python3 ADT files
  aixtools.python3.man.en_US
                             3.8.0.0    C     F    python3 man pages
  aixtools.python3.rte       3.8.0.0    C     F    python3 26-Oct-2019

[ts01]:root:/root # oslevel -s
7100-05-04-1914

95
If you wish to contribute to the issue - consider posting on https://github.com/numpy/numpy/issues/15801
As you can see there I have found what prevents me from having it build at all.
Have you packaged lapack? You also need that library, at least I have always needed it.
96
AIXTOOLS / Re: Not able to install pandas in AIX - pip install pandas throwing error
« Last post by vimal on March 22, 2020, 11:26:14 PM »
Hi
I want to install pandas in python3 using pip. Our server is AIX 7.1 and aixtools.python3 and xlc are already installed. but when i try to install pandas module using pip, it's throwing below error. Please help to fix the issue.


root@db3 / >
# lslpp -l|grep -i xlc
  xlC.aix61.rte             12.1.0.1  COMMITTED  IBM XL C++ Runtime for AIX 6.1
  xlC.cpp                    9.0.0.0  COMMITTED  C for AIX Preprocessor
  xlC.rte                   12.1.0.1  COMMITTED  IBM XL C++ Runtime for AIX
  xlC.sup.aix50.rte          9.0.0.1  COMMITTED  XL C/C++ Runtime for AIX 5.2
root@atdb3 / >
# lslpp -l|grep -i python3
  aixtools.python3.adt       3.8.0.0  COMMITTED  python3 ADT files
  aixtools.python3.man.en_US
                             3.8.0.0  COMMITTED  python3 man pages
  aixtools.python3.rte       3.8.0.0  COMMITTED  python3 26-Oct-2019
root@tdb3 / >
#
# ./pip3 install pandas
Collecting pandas
  Using cached pandas-1.0.3.tar.gz (5.0 MB)
  Installing build dependencies ... error
  ERROR: Command errored out with exit status 1:
   command: /opt/bin/python3.8 /opt/lib/python3.8/site-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-l3vpdn7b/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.org/simple -- setuptools wheel 'Cython>=0.29.13' 'numpy==1.13.3; python_version=='"'"'3.6'"'"' and platform_system!='"'"'AIX'"'"'' 'numpy==1.14.5; python_version>='"'"'3.7'"'"' and platform_system!='"'"'AIX'"'"'' 'numpy==1.16.0; python_version=='"'"'3.6'"'"' and platform_system=='"'"'AIX'"'"'' 'numpy==1.16.0; python_version>='"'"'3.7'"'"' and platform_system=='"'"'AIX'"'"''
       cwd: None
  Complete output (539 lines):
  Ignoring numpy: markers 'python_version == "3.6" and platform_system != "AIX"' don't match your environment
  Ignoring numpy: markers 'python_version >= "3.7" and platform_system != "AIX"' don't match your environment
  Ignoring numpy: markers 'python_version == "3.6" and platform_system == "AIX"' don't match your environment
  Collecting setuptools
    Using cached setuptools-46.0.0-py3-none-any.whl (582 kB)
  Collecting wheel
    Using cached wheel-0.34.2-py2.py3-none-any.whl (26 kB)
  Collecting Cython>=0.29.13
    Using cached Cython-0.29.15-py2.py3-none-any.whl (968 kB)
  Collecting numpy==1.16.0
    Using cached numpy-1.16.0.zip (5.1 MB)
  Installing collected packages: setuptools, wheel, Cython, numpy
      Running setup.py install for numpy: started
      Running setup.py install for numpy: finished with status 'error'
      ERROR: Command errored out with exit status 1:
       command: /opt/bin/python3.8 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-0cb6fbu4/numpy/setup.py'"'"'; __file__='"'"'/tmp/pip-install-0cb6fbu4/numpy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-8fv509uz/install-record.txt --single-version-externally-managed --prefix /tmp/pip-build-env-l3vpdn7b/overlay --compile --install-headers /tmp/pip-build-env-l3vpdn7b/overlay/include/python3.8/numpy
           cwd: /tmp/pip-install-0cb6fbu4/numpy/
      Complete output (519 lines):
      Running from numpy source directory.

      Note: if you need reliable uninstall behavior, then install
      with pip instead of using `setup.py install`:

        - `pip install .`       (from a git repo or downloaded source
                                 release)
        - `pip install numpy`   (last NumPy release on PyPi)


      /tmp/pip-install-0cb6fbu4/numpy/numpy/distutils/misc_util.py:476: SyntaxWarning: "is" with a literal. Did you mean "=="?
        return is_string(s) and ('*' in s or '?' is s)
      blas_opt_info:
      blas_mkl_info:
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmp0zkcswl6/tmp
      creating /tmp/tmp0zkcswl6/tmp/tmp0zkcswl6
      compile options: '-MMD -MF /tmp/tmp0zkcswl6/file.c.d -c'
      xlc_r: /tmp/tmp0zkcswl6/file.c
        libraries mkl_rt not found in ['/opt/lib', '/usr/lib64', '/usr/lib']
        NOT AVAILABLE

      blis_info:
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmpujtbpfxz/tmp
      creating /tmp/tmpujtbpfxz/tmp/tmpujtbpfxz
      compile options: '-MMD -MF /tmp/tmpujtbpfxz/file.c.d -c'
      xlc_r: /tmp/tmpujtbpfxz/file.c
        libraries blis not found in ['/opt/lib', '/usr/lib64', '/usr/lib']
        NOT AVAILABLE

      openblas_info:
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmpekc06an2/tmp
      creating /tmp/tmpekc06an2/tmp/tmpekc06an2
      compile options: '-MMD -MF /tmp/tmpekc06an2/file.c.d -c'
      xlc_r: /tmp/tmpekc06an2/file.c
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmprretltz0/tmp
      creating /tmp/tmprretltz0/tmp/tmprretltz0
      compile options: '-MMD -MF /tmp/tmprretltz0/file.c.d -c'
      xlc_r: /tmp/tmprretltz0/file.c
        libraries openblas not found in ['/opt/lib', '/usr/lib64', '/usr/lib']
        NOT AVAILABLE

      atlas_3_10_blas_threads_info:
      Setting PTATLAS=ATLAS
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmpeiipia1z/tmp
      creating /tmp/tmpeiipia1z/tmp/tmpeiipia1z
      compile options: '-MMD -MF /tmp/tmpeiipia1z/file.c.d -c'
      xlc_r: /tmp/tmpeiipia1z/file.c
        libraries tatlas not found in ['/opt/lib', '/usr/lib64', '/usr/lib']
        NOT AVAILABLE

      atlas_3_10_blas_info:
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmp1i76czrp/tmp
      creating /tmp/tmp1i76czrp/tmp/tmp1i76czrp
      compile options: '-MMD -MF /tmp/tmp1i76czrp/file.c.d -c'
      xlc_r: /tmp/tmp1i76czrp/file.c
        libraries satlas not found in ['/opt/lib', '/usr/lib64', '/usr/lib']
        NOT AVAILABLE

      atlas_blas_threads_info:
      Setting PTATLAS=ATLAS
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmpi0thd13j/tmp
      creating /tmp/tmpi0thd13j/tmp/tmpi0thd13j
      compile options: '-MMD -MF /tmp/tmpi0thd13j/file.c.d -c'
      xlc_r: /tmp/tmpi0thd13j/file.c
        libraries ptf77blas,ptcblas,atlas not found in ['/opt/lib', '/usr/lib64', '/usr/lib']
        NOT AVAILABLE

      atlas_blas_info:
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmp72ghz2_j/tmp
      creating /tmp/tmp72ghz2_j/tmp/tmp72ghz2_j
      compile options: '-MMD -MF /tmp/tmp72ghz2_j/file.c.d -c'
      xlc_r: /tmp/tmp72ghz2_j/file.c
        libraries f77blas,cblas,atlas not found in ['/opt/lib', '/usr/lib64', '/usr/lib']
        NOT AVAILABLE

      accelerate_info:
        NOT AVAILABLE

      /tmp/pip-install-0cb6fbu4/numpy/numpy/distutils/system_info.py:625: UserWarning:
          Atlas (http://math-atlas.sourceforge.net/) libraries not found.
          Directories to search for the libraries can be specified in the
          numpy/distutils/site.cfg file (section [atlas]) or by setting
          the ATLAS environment variable.
        self.calc_info()
      blas_info:
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmp7j58rgkq/tmp
      creating /tmp/tmp7j58rgkq/tmp/tmp7j58rgkq
      compile options: '-MMD -MF /tmp/tmp7j58rgkq/file.c.d -c'
      xlc_r: /tmp/tmp7j58rgkq/file.c
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmpkhde0ksx/tmp
      creating /tmp/tmpkhde0ksx/tmp/tmpkhde0ksx
      compile options: '-MMD -MF /tmp/tmpkhde0ksx/file.c.d -c'
      xlc_r: /tmp/tmpkhde0ksx/file.c
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmpp3v4hkhl/tmp
      creating /tmp/tmpp3v4hkhl/tmp/tmpp3v4hkhl
      compile options: '-I/opt/include -I/usr/include -c'
      xlc_r: /tmp/tmpp3v4hkhl/source.c
      customize UnixCCompiler
      C compiler: xlc_r -DNDEBUG -O -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64 -I/opt/include -O2 -qmaxmem=-1 -qarch=pwr5 -q64

      creating /tmp/tmp51vzbw1e/tmp
      creating /tmp/tmp51vzbw1e/tmp/tmp51vzbw1e
      compile options: '-MMD -MF /tmp/tmp51vzbw1e/file.c.d -c'
      xlc_r: /tmp/tmp51vzbw1e/file.c
        FOUND:
          libraries = ['blas', 'blas']
          library_dirs = ['/usr/lib']
          include_dirs = ['/opt/include', '/usr/include']

        FOUND:
          define_macros = [('NO_ATLAS_INFO', 1)]
          libraries = ['blas', 'blas']
          library_dirs = ['/usr/lib']
          include_dirs = ['/opt/include', '/usr/include']

      /bin/sh: svnversion:  not found
      non-existing path in 'numpy/distutils': 'site.cfg'
      lapack_opt_info:
      lapack_mkl_info:
97
Administration / Template on HMC V8R8.6.0
« Last post by njarray on March 22, 2020, 03:41:04 PM »
Hello,
I use the template function to deploy an AIX partition, with the option "Configure Virtual Fiber Channel storage during deployment".
I would like to modify the numbers of the "Fiber Channel Adapter ID / Partner Adapter ID" cards to follow my own numbering model,
To better identify the cards of my VIOS, especially for Live Partition Mobility etc...
My VIOS and AIX Partition is confugureed with max_virtual_slot = 1000

Frame1 PROD:
 - VIOS1 Server Fiber Channel Adapter ID / Partner Adapter ID: 100,101,102 etc.
 - VIOS2 Server Fiber Channel Adapter ID / Partner Adapter ID: ID 200,201,202 etc.
Frame1 TEST:
 - VIOS3 Server Fiber Channel Adapter ID / Partner Adapter ID: ID 300,301,302 etc.
 - VIOS4 Server Fiber Channel Adapter ID / Partner Adapter ID: ID 400,401,402 etc.
 

When I launch on the HMC:
Templates and OS Images / Partition / Action Deploy
Virtual Storage Configuration / Virual Fiber channel / Edit Connections
When I modify "Next Available" to put my numbers but it is not taken into account, on the VIOS it is the numbers 1,2,3 etc. which are added.

My HMC version:
"version= Version: 8
 Release: 8.6.0
 Service Pack: 3
HMC Build level 20180802.1
MH01784: Fix for HMC V8R8.6.0 SP3 (08-02-2018)
","base_version=V8R8.6.0

Do you have an idea to modify these numbers on the AIX Partition and the VIOS at the time of deployment or on the template ?
Thank you.
98
More on numpy...
Not had much need for it - October 2016, Python2 was the last time I looked at it seriously. And that was version 1.11.2, and we are now at 1.18.2 - so, undoubtedly, there are some AIX issues noone has bothered to report to the project.
I'll be looking into this - eventually I'll have it resolved, but takes patience.
Michael

99
Ah yes, numpy...
a) requires the lapack library - and that needs fortran to build.
b) just tried to test with a 32-bit Python, and discovered that I only have lapack for 64-bit, so I am going to work on that (to have dual lapack support).
c) Not sure about Python3.8 and numpy, based on some of the error messages in your post.
What I want to have - at the end of all this: is two wheels for numpy - and then I'll need to do that three times (at least) for Python3.6, Python3.7 and Python3.8
so d) need time...
So, do not be surprised you are having issues. numpy is a complex build (just as scipy).
100
Missed this yesterday, I'll take a look.
Pages: 1 ... 8 9 [10]