Mercurial > p > roundup > code
annotate test/test_hypothesis.py @ 8446:14c7c07b32d8
feature: add thread local trace_id and trace_reason to logging.
Added trace_id to default logging so that all logs for a given request
share the same trace_id.
This allows correlation of logs across a request.
admin_guide.txt, upgrading.txt:
add docs
update sample configs to include trace_id.
rewrite logging docs in admin_guide. Hopefully they are clearer now.
clean up some stuff in the logging config file docs.
admin.py:
add decorators to run_command to enable trace_id.
change calls to db.commit() to use run_command to get trace_id.
configuration.py:
clean up imports.
update docstrings, comments and inline docs.
add trace_id to default log format.
add function for testing decorated with trace_id.
add support for dumping stack trace in logging.
add check for pytest in sys.modules to enable log propagation when
pytest is running. Otherwise tests fail as the caplog logger doesn't
see the roundup logs.
logcontext.py:
new file to handle thread local contextvar mangement.
mailgw.py:
add decorators for trace_id etc.
scripts/roundup_xlmrpc_server.py:
add decorators for trace_id etc.
fix encoding bug turning bytes into a string.
fix command line issue where we can't set encoding. (not sure if
changing encoding via command line even works)
cgi/client.py
decorate two entry points for trace_id etc.
cgi/wsgi_handler.py:
decorate entry point for trace_id etc.
test/test_config.py:
add test for trace_id in new log format.
test various cases for sinfo and errors in formating msg.
| author | John Rouillard <rouilj@ieee.org> |
|---|---|
| date | Tue, 16 Sep 2025 22:53:00 -0400 |
| parents | 2c6d66819475 |
| children |
| rev | line source |
|---|---|
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
1 import unittest |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
2 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
3 import pytest |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
4 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
5 pytest.importorskip("hypothesis") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
6 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
7 # ruff: noqa: E402 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
8 from hypothesis import example, given, settings |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
9 from hypothesis.strategies import binary, none, one_of, sampled_from, text |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
10 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
11 from roundup.anypy.strings import b2s, s2b, s2u, u2s |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
12 # ruff: noqa: I001 - yes I know I am using \ to continue the line... |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
13 from roundup.password import PasswordValueError, encodePassword, \ |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
14 h64decode, h64encode |
|
7901
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
15 from roundup.password import crypt as crypt_method |
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
16 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
17 def Identity(x): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
18 return x |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
19 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
20 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
21 _max_examples = 1000 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
22 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
23 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
24 class HypoTestStrings(unittest.TestCase): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
25 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
26 @given(text()) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
27 @settings(max_examples=_max_examples) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
28 def test_b2s(self, utf8_bytes): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
29 self.assertEqual(b2s(utf8_bytes.encode("utf-8")), utf8_bytes) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
30 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
31 @given(text()) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
32 @settings(max_examples=_max_examples) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
33 def test_s2b(self, s): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
34 self.assertTrue(isinstance(s2b(s), bytes)) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
35 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
36 @given(text()) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
37 @settings(max_examples=_max_examples) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
38 @example("\U0001F600 hi there") # smiley face emoji |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
39 def test_s2u_u2s_invertable(self, s): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
40 self.assertEqual(u2s(s2u(s)), s) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
41 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
42 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
43 class HypoTestPassword(unittest.TestCase): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
44 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
45 @given(binary()) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
46 @example(b"") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
47 @settings(max_examples=_max_examples) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
48 def test_h64encode_h64decode(self, s): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
49 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
50 self.assertEqual(h64decode(h64encode(s)), s) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
51 |
|
7902
2c6d66819475
fix: missing crypt in python with hypothesis testing.
John Rouillard <rouilj@ieee.org>
parents:
7901
diff
changeset
|
52 crypt_modes = ["PBKDF2S5", "PBKDF2", "SSHA", "SHA", "MD5", |
|
2c6d66819475
fix: missing crypt in python with hypothesis testing.
John Rouillard <rouilj@ieee.org>
parents:
7901
diff
changeset
|
53 "plaintext", "zot"] |
|
2c6d66819475
fix: missing crypt in python with hypothesis testing.
John Rouillard <rouilj@ieee.org>
parents:
7901
diff
changeset
|
54 if crypt_method: |
|
2c6d66819475
fix: missing crypt in python with hypothesis testing.
John Rouillard <rouilj@ieee.org>
parents:
7901
diff
changeset
|
55 crypt_modes.append("crypt") |
|
2c6d66819475
fix: missing crypt in python with hypothesis testing.
John Rouillard <rouilj@ieee.org>
parents:
7901
diff
changeset
|
56 |
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
57 @given(one_of(none(), text()), |
|
7902
2c6d66819475
fix: missing crypt in python with hypothesis testing.
John Rouillard <rouilj@ieee.org>
parents:
7901
diff
changeset
|
58 sampled_from(crypt_modes)) |
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
59 @example("asd\x00df", "crypt") |
|
7902
2c6d66819475
fix: missing crypt in python with hypothesis testing.
John Rouillard <rouilj@ieee.org>
parents:
7901
diff
changeset
|
60 @settings(max_examples=_max_examples) # deadline=None for debugging |
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
61 def test_encodePassword(self, password, scheme): |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
62 |
|
7901
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
63 if scheme == "crypt" and password and "\x00" in password: |
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
64 with self.assertRaises(ValueError) as e: |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
65 encodePassword(password, scheme) |
|
7901
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
66 if crypt_method: |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
67 self.assertEqual(e.exception.args[0], |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
68 "embedded null character") |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
69 else: |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
70 self.assertEqual(e.exception.args[0], |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
71 "Unsupported encryption scheme 'crypt'") |
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
72 elif scheme == "plaintext": |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
73 if password is not None: |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
74 self.assertEqual(encodePassword(password, scheme), password) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
75 else: |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
76 self.assertEqual(encodePassword(password, scheme), "") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
77 elif scheme == "zot": |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
78 with self.assertRaises(PasswordValueError) as e: |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
79 encodePassword(password, scheme) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
80 self.assertEqual(e.exception.args[0], |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
81 "Unknown encryption scheme 'zot'") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
82 else: |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
83 # it shouldn't throw anything. |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
84 pw = encodePassword(password, scheme) |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
85 |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
86 # verify format |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
87 if scheme in ["PBKDF2S5", "PBKDF2"]: |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
88 # 1000$XbSsijELEQbZZb1LlD7CFuotF/8$DdtssSlm.e |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
89 self.assertRegex(pw, r"^\d{4,8}\$.{27}\$.*") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
90 elif scheme == "SSHA": |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
91 # vqDbjvs8rhrS1AJxHYEGGXQW3x7STAPgo7uCtnw4GYgU7FN5VYbZxccQYCC0eXOxSipLbtgBudH1vDRMNlG0uw== |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
92 self.assertRegex(pw, r"^[^=]*={0,3}$") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
93 elif scheme == "SHA": |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
94 # da39a3ee5e6b4b0d3255bfef95601890afd80709' |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
95 self.assertRegex(pw, r"^[a-z0-9]{40}$") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
96 elif scheme == "MD5": |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
97 # d41d8cd98f00b204e9800998ecf8427e' |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
98 self.assertRegex(pw, r"^[a-z0-9]{32}$") |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
99 elif scheme == "crypt": |
|
7901
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
100 # crypt_method is None if crypt is unknown |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
101 if crypt_method: |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
102 # WqzFDzhi8MmoU |
|
9ff94a2e8c82
test: update to handle crypt not available
John Rouillard <rouilj@ieee.org>
parents:
7840
diff
changeset
|
103 self.assertRegex(pw, r"^[A-Za-z0-9./]{13}$") |
|
7827
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
104 else: |
|
604da0650797
test: add basic tests using hypothesis
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
105 self.assertFalse("Unknown scheme: %s, val: %s" % (scheme, pw)) |
