Mailman 3 August 2024 - Python-list

Re: Formatting a str as a number - Okay, one more related thing...
by MRAB Sept. 2, 2024

Sept. 2, 2024

On 2024-08-31 06:31, Gilmeh Serda via Python-list wrote: > On Fri, 30 Aug 2024 05:22:17 GMT, Gilmeh Serda wrote: > >> f"{int(number):>20,}" > > I can find "," (comma) and I can find "_" (underscore) but how about " " > (space)? > > Or any other character, for that matter? > > Any ideas? > > Of course I can do f"{123456:>20_}".replace("_", " "), just thought there > might be something else my search mojo fails on. > The format is described here: https://docs.python.org/3/library/string.html#formatspec A space is counted as a fill character.

2 1

Re: ListAdmin: Is list/archive working correctly?
by Keith Thompson Aug. 31, 2024

Aug. 31, 2024

Ethan Furman <ethan(a)stoneleaf.us> writes: > On 8/30/24 15:28, dn via Python-list wrote: >> The OP was @Gilmeh Serda (from an invalid email address). That appears in the email thread >> >> @Stefan Ram has had two contributions quoted, but no such original-message has appeared in the thread. > > I can't speak about the archives, but I can say that Stefan's posts > are discarded automatically since they are opposed to their words > showing up on the list. I'm posting this on the comp.lang.python Usenet newsgroup. Stefan Ram's posts to comp.lang.python include several header lines, including "X-No-Archive: Yes". I presume the software that copies comp.lang.python posts to python-list pays attention to some of those header lines. (I personally think it's silly to impose this kind of restriction. The Usenet group and the mailing list are both public.) Lawrence D'Oliveiro adds the string "(Posting On Python-List Prohibited)" to the subject on his articles, for reasons he has declined to discuss. I don't know whether the software recognizes that. Can someone who manages the list software discuss the exact rules? I suggest that those rules should be documented on <https://mail.python.org/mailman/listinfo/python-list>. -- Keith Thompson (The_Other_Keith) Keith.S.Thompson+u(a)gmail.com void Void(void) { Void(); } /* The recursive call of the void */

1 0

ListAdmin: Is list/archive working correctly?
by dn Aug. 31, 2024

Aug. 31, 2024

For example, have been following the thread "Is there a better way? [combining f-string, thousands separator, right align]". Me email (only) client shows a thread of 12 messages. The OP was @Gilmeh Serda (from an invalid email address). That appears in the email thread @Stefan Ram has had two contributions quoted, but no such original-message has appeared in the thread. The archive is only showing seven contributions (for some reason Grant's recent contribution under the different subject line: "Formatting a str as a number" appears separately, even though it threads as the same conversation in email) None of the OP's contributions appear! IIRC the design has been that it doesn't matter if a contribution comes from the Newsgroup or the email Discussion List, they are treated the same. Are Newsgroup contributions being archived (were they ever)? Is it user-error that some contributions don't appear on the list, but do appear in replies, or is there perhaps some other cause? -- Regards, =dn

4 3

Sanitise user input for a script
by Simon Connah Aug. 31, 2024

Aug. 31, 2024

I need to write a script that will take some user input (supplied on a website) and then execute a Python script on a host via SSH. I'm curious what the best options are for protecting against malicious input in much the smae way as you sanitise SQL to protect against SQL injections. I could do it either on the website itself or by doing it on the host machine. I'm thinking of using argparse but I'm aware it does not offer any protection itself. If someone has any suggestions I'd appreciated it. If you need more information then please let me know. Simon.

3 4

Script stops running with no error
by Daniel Aug. 29, 2024

Aug. 29, 2024

As you all have seen on my intro post, I am in a project using Python (which I'm learning as I go) using the wikimedia API to pull data from wiktionary.org. I want to parse the json and output, for now, just the definition of the word. Wiktionary is wikimedia's dictionary. My requirements for v1 Query the api for the definition for table (in the python script). Pull the proper json Parse the json output the definition only What's happening? I run the script and, maybe I don't know shit from shinola, but it appears I composed it properly. I wrote the script to do the above. The wiktionary json file denotes a list with this character # and sublists as ## but numbers them On Wiktionary, the definitions are denoted like: 1. blablabla 1. blablabla 2. blablablablabla 2. balbalbla 3. blablabla 1. blablabla I wrote my script to alter it so that the sublist are letters 1. blablabla a. blablabla b. blablabla 2. blablabla and so on /snip At this point, the script stops after it assesses the first line_counter and sub_counter. The code is below, please tell me which stupid mistake I made (I'm sure it's simple). Am I making a bad approach? Is there an easier method of parsing json than the way I'm doing it? I'm all ears. Be kind, i'm really new at python. Environment is emacs. import requests import re search_url = 'https://api.wikimedia.org/core/v1/wiktionary/en/search/page' search_query = 'table' parameters = {'q': search_query} response = requests.get(search_url, params=parameters) data = response.json() page_id = None if 'pages' in data: for page in data['pages']: title = page.get('title', '').lower() if title == search_query.lower(): page_id = page.get('id') break if page_id: content_url = f'https://api.wikimedia.org/core/v1/wiktionary/en/page/ {search_query}' response = requests.get(content_url) page_data = response.json() if 'source' in page_data: content = page_data['source'] cases = {'noun': r'\{en-noun\}(.*?)(?=\{|\Z)', 'verb': r'\{en-verb\}(.*?)(?=\{|\Z)', 'adjective': r'\{en-adj\}(.*?)(?=\{|\Z)', 'adverb': r'\{en-adv\}(.*?)(?=\{|\Z)', 'preposition': r'\{en-prep\}(.*?)(?=\{|\Z)', 'conjunction': r'\{en-con\}(.*?)(?=\{|\Z)', 'interjection': r'\{en-intj\}(.*?)(?=\{|\Z)', 'determiner': r'\{en-det\}(.*?)(?=\{|\Z)', 'pronoun': r'\{en-pron\}(.*?)(?=\{|\Z)' #make sure there aren't more word types } def clean_definition(text): text = re.sub(r'\[\[(.*?)\]\]', r'\1', text) text = text.lstrip('#').strip() return text print(f"\n*** Definition for {search_query} ***") for word_type, pattern in cases.items(): match = re.search(pattern, content, re.DOTALL) if match: lines = [line.strip() for line in match.group(1).split('\n') if line.strip()] definition = [] main_counter = 0 sub_counter = 'a' for line in lines: if line.startswith('##*') or line.startswith('##:'): continue if line.startswith('# ') or line.startswith('#\t'): main_counter += 1 sub_counter = 'a' cleaned_line = clean_definition(line) definition.append(f"{main_counter}. {cleaned_line}") elif line.startswith('##'): cleaned_line = clean_definition(line) definition.append(f" {sub_counter}. {cleaned_line}") sub_counter = chr(ord(sub_counter) + 1) if definition: print(f"\n{word_type.capitalize()}\n") print("\n".join(definition)) break else: print("try again beotch") Thanks, Daniel

4 4

Re: new here
by rbowman Aug. 28, 2024

Aug. 28, 2024

On Sun, 25 Aug 2024 21:29:30 -0400, avi.e.gross wrote: > If everyone will pardon my curiosity, who and what purposes are these > smaller environments for and do many people use them? > > I mean the price of a typical minimal laptop is not a big deal today. So > are these for some sort of embedded uses? > > I read about them ages ago but wonder ... Typically they are used for I/O with the physical world. Some, like the Arduino Nano Sense, have a number of sensors on the board including a 9 axis inertial, temperature, humidity, barometric, microphone, light intensity, and color sensors. MIT chose this for their TinyML course because it was one-stop shopping. Using TinyML, a really cut down version of TensorFlow, gesture, wake word, image recognition, and other tasks were move entirely to the edge device. Others, like the Pico series, bring out the I/O pins but have little onboard. Many pins are multi-purpose and are used for SPI or I2C protocols, PWM, A/D measurements, and plain vanilla digital. The Raspberry Pi series lives in both worlds. Particularly with the new Pi 5, it's usable as a desktop Linux system, if somewhat limited, while bringing out the PIO pins. It's really a different world than a typical laptop. Years (decades?) ago you could subvert the parallel port controller to provide digital I/O but who has seen a parallel port lately? There are many families and devices available that are used for any number of projects that need to interact with the real world. The earliest variants were usually programmed in assembler since 2k of EPROM and 128 bytes of RAM was typical. As they improved C was sued. Now there's enough flash and SRAM to support MicroPython or CircuitPython and they are fast enough for most purposes. There are specialized drivers but if you know Python the bulk of the logic will be very familiar. For example I have a desktop Python app that pulls weather data from NOAA's web API. The Pico W has Wifi, so if I wanted to compare NOAA's temperature, humidity, and barometric pressure to the values I read from a local sensor, the API requests and parsing the JSON reply would be almost identical to the desktop code. Conversely I could use the Pico W as a web server to make its sensor reading available.

2 2

Re: Formatting a str as a number
by Grant Edwards Aug. 27, 2024

Aug. 27, 2024

On 2024-08-27, Gilmeh Serda via Python-list <python-list(a)python.org> wrote: > On 25 Aug 2024 15:46:25 GMT, Stefan Ram wrote: > >> f"{int(number):>20,}" > > Great. Thanks. Do you have a link to where that's documented? > > I did web search, found nothing. https://docs.python.org/3/library/string.html#formatspec https://docs.python.org/3/reference/lexical_analysis.html#f-strings

1 0

Re: Triggered By Mediocre Code (Posting On Python-List Prohibited)
by Piergiorgio Sartor Aug. 27, 2024

Aug. 27, 2024

On 25/08/2024 23.53, Lawrence D'Oliveiro wrote: > Looking at this article about the top three languages for getting > programming jobs > <https://www.zdnet.com/article/want-a-programming-job-make-sure-you-learn-th…>, > naturally I couldn’t help noticing the code in the screenshot at the > top (my transcription): > > bufferedNumber = str(doc.GetTime().GetFrame(docFps)) > if len(bufferedNumber)<4: > for x in range(len(bufferedNumber),4): > bufferedNumber = "0" + bufferedNumber > > I mean, really? Four lines to do what could be done in a single > expression? > > Was that written by a PHP programmer, do you think? That the more correct question would be: What is easier to read? And to debug? The four line version or the one liner? To paraphrase someone: "If the length of a program would be measured by the time needed to understand it, some program would be too short to be short." Because the world is plenty of one liner nobody (almost) doesn't understand. There is even a category in the OCC (https://www.ioccc.org/). Don't get me wrong, I like and dislike one liner. Namely, I like mine and dislike the others :-) bye, -- piergiorgio

1 0

Mocking a function in a process started with multiprocessing.Process
by Norman Robins Aug. 27, 2024

Aug. 27, 2024

Is it possible to mock out a function in a process started with multiprocessing.Process? AI tells me it is, but I have not gotten it to work. The use case is that I have a server I want to write tests for. I want the tests to start up the server, but I need to mock out the JWT based auth functions in the server. If it is possible, perhaps I am doing something wrong. The function I want to mock out is in foo.bar.baz.validate_jwt`. The server imports it as from .baz import validate_jwt. I have tried to mock it many ways, here is the latest attempt: @pytest.fixture(scope="module") def mock_get_public_key(): return PUBLIC_KEY @patch('foo.bar.baz.validate_jwt') def test_fn(mock_validate_jwt, mock_get_public_key): I also tried `@patch('foo.bar.main.validate_jwt')` But no matter what I tried the real functions get called. Here is an example: In directory foo/bar file baz.py def get_public_key(token: str) -> str: print("in get_public_key) def validate_jwt(token: str) -> dict public_key = get_public_key(token) print("in validate_jwt) In directory foo/bar file main.py: from .baz import validate_jwt def server(token): valid = validate_jwt(token) In my test code, which is in test/test_main.py (test and foo are at the same level) @pytest.fixture(scope="module")def mock_get_public_key(): return PUBLIC_KEY def run_server(port): from foo.bar.main import start start(is_prod=False, port=port) @pytest.fixture(scope="module")def mock_validate_jwt(token): return {"user": "test_user"} @pytest.fixture(scope="module")def start_server(): port = 8002 server_process = multiprocessing.Process(target=run_server, args=(port,)) server_process.start() max_retries = 10 for i in range(max_retries): try: response = requests.get(f"http://127.0.0.1:{port}/echo?message=test") if response.status_code == 200: break except requests.ConnectionError: time.sleep(1) else: pytest.fail("Server did not start in time") @pytest.mark.usefixtures("start_server")@patch('dispatcher.main.validate_jwt')def test_function(mock_validate_jwt, mock_get_public_key): , . . When test_function runs the real validate_jwt runs, not my mock.

1 0

Re: Is there a better way? [combining f-string, thousands separator, right align]
by dn Aug. 26, 2024

Aug. 26, 2024

On 26/08/24 03:12, Gilmeh Serda via Python-list wrote: > Subject explains it, or ask. > > This is a bloody mess: > >>>> s = "123456789" # arrives as str >>>> f"{f'{int(s):,}': >20}" > ' 123,456,789' With recent improvements to the expressions within F-strings, we can separate the string from the format required. (reminiscent of FORTRAN which had both WRITE and FORMAT statements, or for that matter HTML which states the 'what' and CSS the 'how') Given that the int() instance-creation has a higher likelihood of data-error, it is recommended that it be a separate operation for ease of fault-finding - indeed some will want to wrap it with try...except. >>> s = "123456789" # arrives as str >>> s_int = int( s ) # makes the transformation obvious and distinct >>> s_format = ">20," # define how the value should be presented >>> F"{s_int:{s_format}}" ' 123,456,789' Further, some of us don't like 'magic-constants', hence (previously): >>> S_FIELD_WIDTH = 20 >>> s_format = F">{S_FIELD_WIDTH}," and if we really want to go over-board: >>> RIGHT_JUSTIFIED = ">" >>> THOUSANDS_SEPARATOR = "," >>> s_format = F"{RIGHT_JUSTIFIED}{S_FIELD_WIDTH}{THOUSANDS_SEPARATOR}" or (better) because right-justification is the default for numbers: >>> s_format = F"{S_FIELD_WIDTH}{THOUSANDS_SEPARATOR}" To the extreme that if your user keeps fiddling with presentations (none ever do, do they?), all settings to do with s_format could be added to a config/environment file, and thus be even further separated from program-logic! -- Regards, =dn

2 2