332 questions
0
votes
1
answer
83
views
Listing root child controls from uiautomation GetRootControl() stuck after the last item for 3+ minutes
I am trying to play around with uiautomation on windows. As a first test, I wanted to list everything in root to investigate what is worth recursing into.
This is my script:
import uiautomation as uia
...
0
votes
0
answers
95
views
LegacyIAccessiblePattern does not exist in the current context
I am targeting a UI element of a Windows desktop application, which has a default action of a double click. I am using .NET framework 4.8, .NET's UIAutomationAPI (WinAppDriver in part, but it needs to ...
0
votes
1
answer
108
views
Python Windows UI Automation to click "close other tabs" button in Microsoft Edge browser
I'm working with the Python UIAutomation for Windows library to create keyboard shortcuts that are missing from Edge. I'd like to be able to trigger a Python script that clicks the "close other ...
0
votes
0
answers
51
views
Get nested element using UIAutomation ElementfromCursor() failed, but with Accessibility Insights succeeded
I'm trying to use UIAutomationClient library in .NET to get the element under the mouse cursor using ElementFromPoint(). This works in general, but when I click any items on PowerPoint slides, I can ...
0
votes
0
answers
57
views
Why UIAutomation WindowOpened Event does not fired?
I want to login to clickonce app programatically.
I have tried with following code.
This app is stock trading (kabus) app is developed by Japanese au Kabucom securities (https://kabu.com/tool/...
1
vote
0
answers
117
views
Performance Issues with UI Automation Tree Search in a Large UI Structure (Table) Using C++
Problem Description:
I am working with the UI Automation framework in C++ to find a particular element in a large UI structure, such as a table (similar to Excel). The target element may be deeply ...
1
vote
0
answers
67
views
How to increase speed when itererating over all controls of a window using UIA?
Whats the best practice or options to speed up the search when you are iterating the entire control list of a window?
I have tried creating a property condition to find only the items that are not ...
0
votes
1
answer
198
views
Crash on calling GetFocusedElement from a thread
I have an Electron app with a native node module written in C++, built with MSVC compiler and linked using CMakeJS.
The node module has hook callbacks installed (SetWindowsHookEx) in separate threads ...
2
votes
1
answer
680
views
Inspect.exe can find elements that UIAutomation cannot find
I have an application written in Qt/C++. It has a Window with child windows ( LocalizedControlType: ‘window’). Inspect can see these child windows, but my C# code using UIAutomation cannot.
Inspect ...
2
votes
1
answer
666
views
How to use FindAll() with the nuget package Interop.UIAutomationClient
I want to use Microsoft UIAutomation, from C#.
I collected some finds I made on the internet and ended up with the following code (using the Nuget package "Interop.UIAutomationClient" ...
1
vote
0
answers
91
views
Optimizing UI Element Search in a Large, Static Desktop Application
I'm currently working on recording data from a desktop application with a relatively static UI structure. The UI includes elements like comboboxes, checkboxes, grids, and buttons. However, when ...
0
votes
1
answer
91
views
Get current song title from Windows Media Player UI in the bottom left
I want to get the text from the UI element in the bottom left of Windows Media Player. I want to store it in a python variable. How can I programmatically navigate the UI hierarchy to achieve this?
0
votes
0
answers
327
views
Possible Memory Leak in UIAutomationClient.DLL in Windows 11
I call the following API using c# over and over again using a timer. All it does is that it gets the top level windows on my desktop and does nothing else.
AutomationElementCollection desktopChildren ...
0
votes
1
answer
561
views
UI Automation to press toolbar button in another application in C#
I am looking for a method to "click" a toolbar button in another application using the UIAutomation namespace. The other application is not written by me and I don't have access to the ...
0
votes
1
answer
565
views
Get the IUIAutomationElement of the "main form" of an application using C++?
I'm programming a console application in C++ in Visual Studio 2022 and I would like to get the IUIAutomationElement of the "main form" (the big, outer form) of a specific application so that ...
0
votes
1
answer
7k
views
Click UI element in window not working on Power Automate Desktop
I am building a flow where I need to use UI clicks using Power Automate Desktop. I want to perform UI clicks on a window where there is a menu items[Basic, Payment, Details].
On starting flow I will ...
1
vote
1
answer
1k
views
How to find UI automation element via UIA_AutomationIdPropertyId
I want to get a group element which is only identifyable by the UIA_AutomationIdPropertyId.
I got the AutomationId from Inspect.exe
So i wrote following function.
IUIAutomationElement* FindBy_UIA_AID(...
1
vote
1
answer
2k
views
How to use UiAutomationClient Without UIAComWrapper Causing Conflict?
I am working on building some ui automation in c# using UIAutomationClient.
It is my understanding that this requires NuGet UIAComWrapper as well.
Without UIAComWrapper, the decleration 'using ...
1
vote
0
answers
595
views
IUIAutomationElement to WinRT AutomationElement mapping in C#
I am trying to use Microsoft UI Automation Project.
What I understand so far after reading through the Functional Tests, that are part of Project, that IUIAutomationElement needs to be converted to ...
1
vote
0
answers
540
views
UI Automation Performance
I see that traversing UI Tree of of any Application, that supports UI Automation and has about 1k elements, takes time in excess of 8 seconds at least, using UI Automation COM library. Tree Walk is ...
2
votes
1
answer
197
views
Convert IUIAutomationElement to IUIAutomationElement6, to invoke get_CurrentFullDescription method
I need to get fullDescription property of a UI element using get_CurrentFullDescription method of UIAutomation library of c++ windows.
Issue is I have element as IUIAutomationElement instead of ...
0
votes
0
answers
425
views
IUIAutomation not declared in this scope. & undefined reference to `CLSID_CUIAutomation'. MinGW64 uiautomationcore.h is wrong?
I'm currently developing a screen reader project using C++. The problem starts when i tried to create an IUIAutomation object instance. The vscode and the g++ complains that IUIAutomation is undefined,...
0
votes
0
answers
188
views
Issue with setting UI Automation value on Excel
I have an issue with setting value in Excel with UI Automation.
I can get all the cells and their information howver I am unable to set the AutomationElement by using method ValuePattern.SetValue()
...
0
votes
0
answers
346
views
Iaccessible interface , call to accChild[] does not give child element name , accChildCount returns the count properly
I have written the below functions in C# (GetObjectByName and GetAccessibleChildren) by calling oleacc.dll. I am not able to understand when there is child of child items, it is not getting their name,...
0
votes
0
answers
1k
views
UIAutomation FlaUI - Detect Both Closing and Opening Windows at the Application Level
I have successfully used the solution for detecting opening windows described here: UIAutomation FlaUI - Detect opening windows on application level.
However, I would also like to also detect closing ...
1
vote
0
answers
451
views
UI Automation - WinForms button handler not triggering
Using the Microsoft UI Automation framework, I've setup an example where if I press a hotkey, it registers an event handler for the AutomationElement under the cursor (typically a button).
However ...
0
votes
0
answers
263
views
UI Automation in UWP application for detecting controls in another application
I want to access control elements of an application using UI Automation framework. The current codebase is built is a UWP application and I want to extend this feature on it. I wrote a c++ script ...
0
votes
1
answer
376
views
How to allow uiAccess in UWP application
I am invoking C++ UIautomation modules in my UWP application. The application is not able to extract control elements since it is not running in an elevated environment. How should I set up the ...
2
votes
0
answers
201
views
Are there updated UIAutomation DLLs? (creating custom pattern in c#)
In my WPF c# program, I'm trying to implement a custom pattern for Windows UIAutomation, which means I need to import something that knows about IUIAutomationPatternHandler, and the only way I can ...
0
votes
0
answers
476
views
How add pattern and/or property to UIAutomation (C#)
We are using Microsoft's UIAutomation stuff to implement some automated UI tests, and that's working reasonably well, but now we're running into a limitation that we can't figure out how to get around....
0
votes
0
answers
390
views
Getting cannot request a property or pattern that is not cached error
I'm trying to get all properties of an automation element present at specific point on desktop or
which currently have mouse focus using UI Automation C# API. For this, I am using GetPhysicalCursorPos(...
0
votes
2
answers
2k
views
UIAutomation FlaUI - Detect opening windows on application level
I am using FlaUI for test automation and it works fine so far. Now I am trying to detect opening windows and while plain UIAutomation offers to register an eventhandler for "AutomationElement....
0
votes
1
answer
981
views
UIAutomation failing to find child nodes
Trying to automate IIS (INetMgr) trying to use UIAutomation, i'm fixing mixed results. I'm able to get some if the screen elements good fine, others, even immediate children nodes, can't get either ...
2
votes
0
answers
903
views
Is there a way to get the URL of a site opened in a browser in app mode using Microsoft's UI Automation API?
Using the Windows Automation UI (System.Windows.Automation) in C# I can get the URL from a browser window:
return parent?.FindFirst
(
TreeScope.Descendants,
new PropertyCondition(AutomationElement....
0
votes
1
answer
797
views
Set the checkbox state in the window in which the window title changes dynamically (UI automation > Form filling)
I'm trying to create a flow where it checks the status of the checkbox for multiple windows (i.e. Windows app which changes the title dynamically). Currently, "set checkbox state window" in ...
-2
votes
1
answer
347
views
Better way to test multiple websites through automation
I am trying to find a better automation tool to perform the websites testing automatically to identify the bugs using various mobile devices and browsers.
Tried with various no code automation tools ...
1
vote
1
answer
2k
views
UI Automation to navigate Microsoft Edge without going through Selenium?
I'm developing some UI Automation work for a WPF program in VB.Net and have had great success. . . until trying to automate Web Browsers.
With Chrome there's --force-renderer-accessibility which was a ...
1
vote
1
answer
669
views
Accessing a grid control with UIAutomation in .NET 5
We've got a C# GUI application (WPF) that for various reasons uses .NET Core 3.1. In that application we have a custom grid control that we would like to talk to using UIAutomation.
Our test harness ...
2
votes
0
answers
358
views
How to use Dynamic annotation with Microsoft UI Automation?
MSAA (Microsoft Active Accessibility) allows dynamic annotation wherein certain accessibility properties of controls can be set without having to re-implement MSAA interfaces. Specifically server ...
0
votes
0
answers
153
views
Cast object of same type from different assemblies
I need to cast ControlType object that belongs to the struct AutomationElementInformation from Interop.UIAutomationClient.dll to UIAComWrapper.dll. Both belongs to namespace System.Windows.Automation.
...
0
votes
0
answers
954
views
What is the name of the Microsoft UI Automation API tester tool that Microsoft made?
Windows has a UI Automation API, and there is a small tool written by Microsoft that allows one to test and verify that a UI automation server implementation is working correctly. Its UI resembles ...
0
votes
0
answers
218
views
(C#) "STATE_SYSTEM_BUSY" in automationElement.Patterns.LegacyIAccessible.Pattern.State
i am programming the uiautomation, but some applications that i used to test the uiautomation, the LegacyIAccessible.State contain STATE_SYSTEM_BUSY. I had tried to wait the more than 1hour. It still ...
-1
votes
1
answer
178
views
Use Windows UIAutomation to tap on WPF TextBox
My WPF Windows Desktop application is with touch support - so when I tap on TextBox the keyboard pops up.
I'm trying to write a test using Windows UIAutomation for my WPF application.
I want to "...
0
votes
0
answers
233
views
How to find specific element within the iframe of electron app?
I am using the code similar to this one https://learn.microsoft.com/en-us/windows/win32/winauto/uiauto-howto-find-ui-elements#finding-an-element-by-name
for getting specific element within a window ...
1
vote
1
answer
597
views
UIAutomation GetTopLevelWindowByName
Trying to follow the example found here:
https://learn.microsoft.com/en-us/windows/win32/winauto/uiauto-howto-find-ui-elements
WCHAR window_name[250] = L"tools";
IUIAutomationElement *window ...
0
votes
1
answer
1k
views
Get HWND under the cursor to use with UIAutomation
I'm trying to get the info about the current window under the cursor, I got the function working when I manually specify the hwnd, how I could get the hwnd from the current window under the mouse?
#...
0
votes
0
answers
400
views
C# UIAutomation crashes Excel
we are using .NET-Framework UIAutomation in our WPF application. We want to be notified when user switches to another Microsoft application, e.g. Excel. Here is our code to register the ...
1
vote
0
answers
391
views
C# UI Automation Focus Event not working with notepad++
I have created a simple UI Automation Program that reports if the focus in a program changes. For example if I have multiple files open in VS 2019 and I click on the tabs to view the different files ...
-1
votes
1
answer
343
views
C# Handle UI Automation text selected event
I am trying to find information on how to code a selectedtext event handler with C# UI automation and notepad. A google search only turned up the following article:
https://learn.microsoft.com/en-us/...
0
votes
1
answer
781
views
Windows UI Automation - Not Finding Window
I'm working on a VBA program to help automate a task using UI Automation, but I've run into an issue where the window of the program I'm trying to control does not show up as a child of the Root ...