User Tools

Site Tools


other:python:misc_by_jyp

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
other:python:misc_by_jyp [2021/07/07 13:07]
jypeter Added the paths/filenames section
other:python:misc_by_jyp [2021/09/17 14:05]
jypeter [Printing a readable version of long lists or dictionaries] Added long list example
Line 2: Line 2:
  
 <WRAP center round tip 60%> <WRAP center round tip 60%>
-You will find on this page some useful, but unsorted, python tips and tricks that can't fit in a section of the main [[other:​python:​jyp_steps|JYP'​s recommended steps for learning python]] page+You will find on this page some **useful, but unsorted, python tips and tricks** that can't fit in a section of the main [[other:​python:​jyp_steps|JYP'​s recommended steps for learning python]] page
 </​WRAP>​ </​WRAP>​
  
Line 49: Line 49:
     * Available since Python version 3.4     * Available since Python version 3.4
     * [[https://​docs.python.org/​3/​library/​pathlib.html#​correspondence-to-tools-in-the-os-module|Matching pathlib, and os or os.path functions]]     * [[https://​docs.python.org/​3/​library/​pathlib.html#​correspondence-to-tools-in-the-os-module|Matching pathlib, and os or os.path functions]]
 +  * [[https://​docs.python.org/​3/​library/​shutil.html|High-level file operations]]
 +
 +
 +=== Example: getting the full path of the Python used ===
 +
 +Note: the actual python may be different from the default python!
 +
 +<​code>​$ which python
 +/​usr/​bin/​python
 +
 +$ /​modfs/​modtools/​miniconda3//​envs/​analyse_3.6_test/​bin/​python
 +>>>​ import sys, shutil
 +>>>​ shutil.which('​python'​)
 +'/​usr/​bin/​python'​
 +>>>​ sys.executable
 +'/​modfs/​modtools/​miniconda3//​envs/​analyse_3.6_test/​bin/​python'</​code>​
 +
 +
 +=== Example: getting the full path of a script ===
 +
 +<​code>>>>​ import os
 +>>>​ os.getcwd()
 +'/​home/​jypmce/​PMIP4'​
 +>>>​ os.path.exists('​./​argv_test.py'​)
 +True
 +>>>​ os.path.abspath('​./​argv_test.py'​)
 +'/​home/​jypmce/​PMIP4/​argv_test.py'​
 +>>>​ os.path.exists('/​home/​jypmce/​PMIP4/​argv_test.py'​)
 +True
 +</​code>​
 +
 +
 +=== Example: getting the size(s) of all the files in a directory ===
 +
 +<​code>​$ cd /​data/​jypmce/​TestDir
 +$ ls -l
 +total 72
 +-rw-r--r-- 1 jypmce ipsl 18147 Jun 25  2012 get_TS_cmip5.py
 +-rw-r--r-- 1 jypmce ipsl 16152 Jun 21  2012 get_TS_cmip5.py~
 +-rw-r--r-- 1 jypmce ipsl 13954 Jul  3  2012 get_TS_cmip5_regular.py
 +-rw-r--r-- 1 jypmce ipsl 16539 Jun 22  2012 get_TS_cmip5_regular.py~</​code>​
 +
 +<​code>>>>​ os.chdir('/​data/​jypmce/​TestDir'​)
 +>>>​ print(os.getcwd())
 +/​data/​jypmce/​TestDir
 +>>>​ files_list = os.listdir()
 +>>>​ files_list
 +['​get_TS_cmip5.py~',​ '​get_TS_cmip5_regular.py',​ '​get_TS_cmip5_regular.py~',​ '​get_TS_cmip5.py'​]
 +>>>​ files_sizes = list(map(os.path.getsize,​ files_list))
 +>>>​ files_sizes
 +[16152, 13954, 16539, 18147]
 +>>>​ sum(files_sizes)
 +64792</​code>​
 +
 +==== Generating file names ====
 +
 +=== Name depending on the current date/time ===
 +
 +<​code>>>>​ import time
 +>>>​ plot_version = time.strftime('​%Y%m%d_%H%M'​)
 +>>>​ f_name = '​test_%s.nc'​ % (plot_version,​)
 +>>>​ f_name
 +'​test_20210827_1334.nc'​
 +</​code>​
 +
 +=== Temporary file ===
 +
 +<​code>>>>​ import tempfile, os
 +>>>​ f_tmp = tempfile.NamedTemporaryFile(mode='​w',​ suffix='​.nc',​ delete=False)
 +>>>​ f_tmp
 +<​tempfile._TemporaryFileWrapper object at 0x2b5614743820>​
 +>>>​ f_tmp.name
 +'/​tmp/​tmpi6uk9hre.nc'​
 +>>>​ f_tmp.close()
 +>>>​ os.remove(f_tmp.name)</​code>​
 ==== Using command-line arguments ==== ==== Using command-line arguments ====
  
Line 84: Line 159:
  
 [[https://​docs.python.org/​3/​library/​argparse.html|argparse]] (//parser for command-line options, arguments and sub-commands//​) is available since Python version 3.2 [[https://​docs.python.org/​3/​library/​argparse.html|argparse]] (//parser for command-line options, arguments and sub-commands//​) is available since Python version 3.2
 +
 +==== Using ordered dictionaries ====
 +
 +**Dictionary order is guaranteed to be insertion order**! Note that the [[https://​docs.python.org/​3/​library/​stdtypes.html#​dict|usual Python dictionary]] also guarantees the order since version **3.6**
 +
 +Check the [[https://​docs.python.org/​3/​library/​collections.html#​collections.OrderedDict|OrderedDict class]] (''​from collections import OrderedDict''​) and the [[https://​realpython.com/​python-ordereddict/​|OrderedDict vs dict in Python: The Right Tool for the Job]] tutorial
 +
 +==== Printing a readable version of long lists or dictionaries ====
 +
 +The [[https://​docs.python.org/​3/​library/​pprint.html|pprint]] module can be used for //pretty printing// objects (lists, dictionaries,​ ...). It will wrap long lines in a meaningful way
 +
 +<​code>>>>​ import pprint
 +
 +>>>​ test_dic = {'​AWI-ESM-1-1-LR_AWI':​{'​r1i1p1f1':​ {'​grid':​ '​gn'​}},​ '​CESM2_NCAR':​{'​r1i1p1f1':​ {'​grid':​ '​gn'​}},​ '​IPSL-CM6A-LR_IPSL':​{'​r1i1p1f1':​ {'​grid':​ '​gr'​},​ '​r1i1p1f2':​ {'​grid':​ '​gr'​},​ '​r1i1p1f3':​ {'​grid':​ '​gr'​},​ '​r1i1p1f4':​ {'​grid':​ '​gr'​}}}
 +
 +>>>​ print(test_dic)
 +{'​AWI-ESM-1-1-LR_AWI':​ {'​r1i1p1f1':​ {'​grid':​ '​gn'​}},​ '​CESM2_NCAR':​ {'​r1i1p1f1':​ {'​grid':​ '​gn'​}},​ '​IPSL-CM6A-LR_IPSL':​ {'​r1i1p1f1':​ {'​grid':​ '​gr'​},​ '​r1i1p1f2':​ {'​grid':​ '​gr'​},​ '​r1i1p1f3':​ {'​grid':​ '​gr'​},​ '​r1i1p1f4':​ {'​grid':​ '​gr'​}}}
 +
 +>>>​ pprint.pprint(test_dic)
 +{'​AWI-ESM-1-1-LR_AWI':​ {'​r1i1p1f1':​ {'​grid':​ '​gn'​}},​
 + '​CESM2_NCAR':​ {'​r1i1p1f1':​ {'​grid':​ '​gn'​}},​
 + '​IPSL-CM6A-LR_IPSL':​ {'​r1i1p1f1':​ {'​grid':​ '​gr'​},​
 +                       '​r1i1p1f2':​ {'​grid':​ '​gr'​},​
 +                       '​r1i1p1f3':​ {'​grid':​ '​gr'​},​
 +                       '​r1i1p1f4':​ {'​grid':​ '​gr'​}}}
 +                       
 +>>>​ dir(test_dic)
 +['​__class__',​ '​__contains__',​ '​__delattr__',​ [... lots of unreadable stuff removed...] '​setdefault',​ '​update',​ '​values'​]
 +
 +>>>​ pprint.pprint(dir(test_dic))
 +['​__class__',​
 + '​__contains__',​
 +
 +[... lots of lines removed in this example ]
 +
 + '​setdefault',​
 + '​update',​
 + '​values'​]
 +
 +</​code>​
  
 /* /*
other/python/misc_by_jyp.txt · Last modified: 2023/12/08 15:51 by jypeter