Skip to content

Update python unit test generation#1763

Merged
tamarinvs19 merged 192 commits intomainfrom
tamarinvs19/utbot-python-stable
Feb 10, 2023
Merged

Update python unit test generation#1763
tamarinvs19 merged 192 commits intomainfrom
tamarinvs19/utbot-python-stable

Conversation

@tamarinvs19
Copy link
Copy Markdown
Collaborator

@tamarinvs19 tamarinvs19 commented Jan 31, 2023 •
edited
Loading

Description

It is a new version of Python UTBot.

Updates:

  • Now we use only new fuzzing platform
  • New python object serialization and deserialization strategy
  • New type inference algorithm
  • Remove python3parser (it was the biggest dependency)
  • Simple state after / state before asserts

How to test

Manual tests

We have some examples in /utbot-python/samples directory.

Self-check list

  • I've set the proper labels for my PR (at least, for category and component).
  • PR title and description are clear and intelligible.
  • I've added enough comments to my code, particularly in hard-to-understand areas.
  • The functionality I've repaired, changed or added is covered with automated tests.
  • Manual tests have been provided optionally.
  • The documentation for the functionality I've been working on is up-to-date.

@tochilinak @tamarinvs19
All current work on mypy annotations
1edc7d4
@tochilinak @tamarinvs19
Added some tests for AnnotationsFromMypy.kt
b10214b
@tochilinak @tamarinvs19
Python type hierarchy in TypeMetaData
1f4d498
@tochilinak @tamarinvs19
removed NamedType; removed some extra things in AnnotationsFromMypy.kt
771ed80
@tochilinak @tamarinvs19
Finished PythonTypeWrapperForComparison
a6acacb
@tochilinak @tamarinvs19
Added variance in TypeVars
594d910
@tochilinak @tamarinvs19
Implemented mro calculation
bf0594a
@tochilinak @tamarinvs19
Added PythonSubtypeChecker
48abd93
@tochilinak @tamarinvs19
Fixed simple case of infinite recursion
864285b
@tochilinak @tamarinvs19
Extracting info only about defined values in user files
485e74c
@tochilinak @tamarinvs19
Added substitution by index
040232b
@tochilinak @tamarinvs19
Added BuiltinTypes object
09f61c8
@tochilinak @tamarinvs19
added initialization of list, dict and set
21827f2
@tochilinak @tamarinvs19
Extracting some other builtin types
c721291
@tochilinak @tamarinvs19
added extraction of argument names
59cfedf
@tochilinak @tamarinvs19
Removed StatefulType
8155f62
@tochilinak @tamarinvs19
Added simple constraint propagation; added createTypeWithNewAnnotatio…
5ea9e3c 
…nParameters
@tochilinak @tamarinvs19
added PythonTypeStorage
4cb0d1d
@tochilinak @tamarinvs19
Changed TODO's in PythonType.kt
c8b101e
@tochilinak @tamarinvs19
Fix in reading PythonTypeStorage
d33d5b2
@tochilinak @tamarinvs19
Extract isAbstract for concrete types from mypy
26ddd03
@tochilinak @tamarinvs19
Removed some redundant files
1d86c57
@tochilinak @tamarinvs19
Added numberOfArguments in CallableTypeDescription
cda6acc
@tochilinak @tamarinvs19
Added pythonTypeRepresentation
f7028db
@tochilinak @tamarinvs19
New mypy run
98b7c61
@tochilinak @tamarinvs19
Changed PythonMethod; generation of mypy check code
f53a290
@tochilinak @tamarinvs19
Added new mypy type checking
51485c1
@tochilinak @tamarinvs19
Added extraction of expression types
c40d085
@tochilinak @tamarinvs19
New version of mypy runner
643b1fc
@tochilinak @tamarinvs19
Added 'file to module' map
c14d6c3
@Markoutte
Copy link
Copy Markdown
Collaborator

Markoutte commented Feb 6, 2023

At the moment it throws an exception for a method that isn't declared with class:

def test(self, x):
    if (x < 0):
        return -1
    return x*x

print(test(2))

When trying to generate for method test it throws:

java.lang.NullPointerException
	at org.utbot.python.PythonTestCaseGenerator.findMethodByDescription(PythonTestCaseGenerator.kt:54)
	at org.utbot.python.PythonTestCaseGenerator.generate(PythonTestCaseGenerator.kt:98)
	at org.utbot.python.PythonTestGenerationProcessor.processTestGeneration(PythonTestGenerationProcessor.kt:109)
	at org.utbot.python.PythonTestGenerationProcessor.processTestGeneration$default(PythonTestGenerationProcessor.kt:32)
	at org.utbot.intellij.plugin.language.python.PythonDialogProcessor$createTests$1.run(PythonDialogProcessor.kt:161)

Markoutte
Markoutte requested changes Feb 6, 2023
View reviewed changes
Copy link
Copy Markdown
Collaborator

@Markoutte Markoutte left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please, update branch to make it compilable with changes in JS module

Markoutte
Markoutte approved these changes Feb 10, 2023
View reviewed changes
utbot-python-parser/build.gradle Outdated
repositories {
mavenCentral()
}

Copy link
Copy Markdown
Collaborator

@Markoutte Markoutte Feb 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like we can drop lines before this to unify build.gradle with other project's modules.

Copy link
Copy Markdown
Collaborator Author

@tamarinvs19 tamarinvs19 Feb 10, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed

@tamarinvs19 tamarinvs19 merged commit 56f76da into main Feb 10, 2023
@tamarinvs19 tamarinvs19 deleted the tamarinvs19/utbot-python-stable branch February 10, 2023 10:47
@Markoutte Markoutte mentioned this pull request Feb 10, 2023
Merged
6 tasks
@alisevych alisevych mentioned this pull request Feb 27, 2023
Closed
@alisevych alisevych added this to the 2023.03 Release milestone Mar 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Markoutte Markoutte Markoutte approved these changes

@denis-fokin denis-fokin Awaiting requested review from denis-fokin

Assignees

@tamarinvs19 tamarinvs19

@tochilinak tochilinak

Labels

comp-fuzzing Issue is related to the fuzzing ctg-enhancement New feature, improvement or change request lang-python Issue is related to python support

Projects

None yet

Milestone

2023.3 Release

Development

Successfully merging this pull request may close these issues.

4 participants

@tamarinvs19 @Markoutte @tochilinak @alisevych