ci: Add macOS desktop runtime tests #17333

jeromelaban · 2024-06-27T16:05:13Z

GitHub Issue (If applicable): closes #

PR Type

What kind of change does this PR introduce?

What is the current behavior?

What is the new behavior?

PR Checklist

Please check if your PR fulfills the following requirements:

Docs have been added/updated which fit documentation template (for bug fixes / features)
Unit Tests and/or UI Tests for the changes have been added (for bug fixes / features) (if applicable)
Validated PR Screenshots Compare Test Run results.
Contains NO breaking changes
Associated with an issue (GitHub or internal) and uses the automatic close keywords.
Commits must be following the Conventional Commits specification.

Other information

Internal Issue (If applicable):

unodevops · 2024-06-27T16:29:52Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

unodevops · 2024-06-27T16:43:19Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-06-27T18:09:13Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-06-27T18:44:50Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-03T18:40:56Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-03T18:49:44Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-03T20:04:50Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

spouliot · 2024-11-03T20:37:41Z

❌ (F) Check_FontFallback_Shaping()
EXCEPTION>Images have different resolutions. 
expected:(98,34)
actual  :(97,34)
The actual image is not the same as the expected one.
actual RSMD: 0.1720096541053666
threshold: 0.15

Looks like a minor difference, where the bitmap's width is smaller, by a pixel, than expected. That test is already ignored for X11.

screenshot1.png

screenshot2.png

I think we should bump the threshold to 0.18 to cover the difference. Also we can remove the separate width/height checks since the ImageAssert.AreSimilarAsync already does it.

The alternative would be to ignore the test for macOS (like X11) but without testing it we run into the risk of larger regressions.

@Youssef1313 ?

unodevops · 2024-11-03T20:39:29Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

spouliot · 2024-11-03T20:42:54Z

❌ (F) When_Large_List_Scroll_To_End_Then_Back_Up_TryClick()
EXCEPTION>Assert.Fail failed. ImageAssert.HasColorAt @ line 1991
====================
Color at (70,65) is not expected
expected: FF1A69A6 #FF1A69A6
actual  : FF1A6AA7 #FF1A6AA7
tolerance : 0
difference: 1
screenshot size: 100x500

Also looks like a minor difference and pass if the tolerance is set to 1.

@Youssef1313 ? @ramezgerges ?

Screenshot

spouliot · 2024-11-03T20:43:36Z

The other failures all seems to be keyboard related, mostly because the shortcuts between macOS and Windows are different by design.

I'll be fixing them in upcoming commits...

ramezgerges · 2024-11-03T21:00:42Z

❌ (F) When_Large_List_Scroll_To_End_Then_Back_Up_TryClick()
EXCEPTION>Assert.Fail failed. ImageAssert.HasColorAt @ line 1991
====================
Color at (70,65) is not expected
expected: FF1A69A6 #FF1A69A6
actual  : FF1A6AA7 #FF1A6AA7
tolerance : 0
difference: 1
screenshot size: 100x500

Also looks like a minor difference and pass if the tolerance is set to 1.

@Youssef1313 ? @ramezgerges ?

This is a bit weird, why would it be different between platforms (unless there's a bug in the metal backend in skia)? I would try testing this with skiasharp 3 and see if that fixes things. SK3 already fixes a bunch of linux-specific bugs. Anyway, I guess adding a tolence of 1 when MACOS is fine.

Youssef1313 · 2024-11-03T23:14:24Z

For Check_FontFallback_Shaping, the one pixel difference is a bug that is acceptable currently. Space widths can differ from font to another, and we may use wrong font to determine space width in some cases.

unodevops · 2024-11-04T01:52:06Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-04T01:58:12Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-04T15:27:52Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-04T16:07:32Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-04T17:51:01Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-04T17:51:03Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

…macOS/skia

…back_Shaping

unodevops · 2024-11-04T20:11:21Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-04T21:19:27Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

…n macOS/skia

unodevops · 2024-11-04T23:17:39Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-04T23:21:09Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-05T17:40:15Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-05T18:01:42Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-06T00:53:02Z

🤖 Your Docs stage site is ready! Visit it here: https://unodocsprstaging.z13.web.core.windows.net/pr-17333/index.html

unodevops · 2024-11-06T03:00:32Z

🤖 Your WebAssembly Sample App stage site is ready! Visit it here: https://unowasmprstaging.z20.web.core.windows.net/pr-17333/index.html

nventive-devops · 2024-11-06T06:29:18Z

The build 146184 found UI Test snapshots differences: android-28-net8: 18, android-28-net8-Snap: 43, ios: 8, ios-Snap: 57, skia-gtk-screenshots: 67, skia-linux-screenshots: 68, skia-windows-screenshots: 64, wasm: 455, wasm-automated-net9.0-UWP-Default-automated: 26, wasm-automated-net9.0-UWP-RuntimeTests-0: 0, wasm-automated-net9.0-UWP-RuntimeTests-1: 0, wasm-automated-net9.0-UWP-RuntimeTests-2: 0, wasm-automated-net9.0-WinUI-Benchmarks-automated: 0, wasm-automated-net9.0-WinUI-RuntimeTests-0: 0, wasm-automated-net9.0-WinUI-RuntimeTests-1: 0, wasm-automated-net9.0-WinUI-RuntimeTests-2: 0

Details

android-28-net8: 18 changed over 829
🚨🚨 Comparison Details (first 20) 🚨🚨
- ComboBoxTests_Fullscreen_Popup_Generic_Opened
- ComboBoxTests_Fullscreen_Popup_Generic_SamplesApp_Wasm_Windows_UI_Xaml_Controls_ComboBox_ComboBox_FullScreen_Popup
- DecimalFormatterTest_UITests_Shared_Microsoft_UI_Xaml_Controls_NumberBoxTests_NumberBoxPage
- Detereminate_ProgressRing_Validation50_[#FF0000_#008000_#008000_#FF0000]_Progress-Ring-Value-50
- Detereminate_ProgressRing_Validation25_[#FF0000_#008000_#FF0000_#FF0000]_Progress-Ring-Value-25
- When_NoSelectionWithItemClick_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
- When_NoSelection_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
- When_SingleSelectionWithItemClick_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
- Detereminate_ProgressRing_Validation75_[#FF0000_#008000_#008000_#008000]_Progress-Ring-Value-75
- WebView_NavigateToAnchor_Initial
- FocusManager_GetFocusedElement_Rectangle_Validation_Uno_UI_Samples_Content_UITests_FocusTests_FocusManager_GetFocus_Automated
- ListView_SelectedItems_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewSelectedItems
- ProgressRing_Visibility_Collapsed_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220
- SequentialAnimations_SamplesApp_Windows_UI_Xaml_Media_Animation_SequentialAnimationsPage
- When_Parent_PointerMoved_After_drag_on_non-scrolling_ScrollViewer
- When_Parent_PointerMoved_After_drag_on_ScrollViewer_-_touch
- ProgressRing_IsEnabled_Running_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220
- UpDownEnabledTest_UITests_Shared_Microsoft_UI_Xaml_Controls_NumberBoxTests_NumberBoxPage
android-28-net8-Snap: 43 changed over 1067
🚨🚨 Comparison Details (first 20) 🚨🚨
- MUX_NumberBox_UITests_Shared_Microsoft_UI_Xaml_Controls_NumberBoxTests_NumberBoxPage
- NavigationView_MUXControlsTestApp_NavigationViewTopNavOnlyPage_MUXControlsTestApp_NavigationViewTopNavOnlyPage
- NavigationView_MUXControlsTestApp_NavigationViewTopNavPage_MUXControlsTestApp_NavigationViewTopNavPage
- TextBox_Input_InputScope_PhoneNumber_Uno_UI_Samples_Content_UITests_TextBoxControl_Input_InputScope_PhoneNumber
- TextBox_Input_InputScope_Search_Uno_UI_Samples_Content_UITests_TextBoxControl_Input_InputScope_Search
- TextBox_Input_InputScope_Url_Uno_UI_Samples_Content_UITests_TextBoxControl_Input_InputScope_Url
- TextBox_Input_Multiline_AutoHeight_Uno_UI_Samples_Content_UITests_TextBoxControl_Input_Multiline_AutoHeight
- Border_Border_CornerRadius_Gradient_UITests_Windows_UI_Xaml_Controls_BorderTests_Border_CornerRadius_Gradient
- ListView_ListViewSelectedItems_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewSelectedItems
- ListView_ListView_With_ListViews_Count_Measure_UITests_Shared_Windows_UI_Xaml_Controls_ListView_ListView_With_ListViews_Count_Measure
- Buttons_AppBar_KeyBoard_Uno_UI_Samples_Content_UITests_ButtonTestsControl_AppBar_KeyBoard
- TabView_UITests_Microsoft_UI_Xaml_Controls_TabViewTests_TabViewPage_UITests_Microsoft_UI_Xaml_Controls_TabViewTests_TabViewPage
- TeachingTip_UITests_Microsoft_UI_Xaml_Controls_TeachingTipTests_TeachingTipPage_UITests_Microsoft_UI_Xaml_Controls_TeachingTipTests_TeachingTipPage
- Border_AutoBorderStretchwithtopmargin_Uno_UI_Samples_UITests_BorderTestsControl_AutoBorderStretchwithtopmargin
- Border_Border_CornerRadius_Uno_UI_Samples_UITests_BorderTestsControl_Border_CornerRadius
- Buttons_AppBarButtonTest_Uno_UI_Samples_Content_UITests_ButtonTestsControl_AppBarButtonTest
- Gesture_Recognizer_Pointer_Events_test_bench_UITests_Shared_Windows_UI_Input_GestureRecognizer_PointersEvents
- NavigationView_MUXControlsTestApp_NavigationViewCustomThemeResourcesPage_MUXControlsTestApp_NavigationViewCustomThemeResourcesPage
- TextBlock_TextBlock_LineHeight_Multiline_Uno_UI_Samples_Content_UITests_TextBlockControl_TextBlock_LineHeight_Multiline
- Border_Border_CornerRadius_Binding_Uno_UI_Samples_UITests_BorderTestsControl_Border_CornerRadius_Binding
ios: 8 changed over 267
🚨🚨 Comparison Details (first 20) 🚨🚨
- TextBox_UpdatedBinding_On_OneWay_Mode_UITests_Windows_UI_Xaml_Controls_TextBox_TextBox_Bindings
- When_NoSelection_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
- When_SingleSelectionWithItemClick_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
- Check_ListView_Swallows_Measure_UITests_Shared_Windows_UI_Xaml_Controls_ListView_ListView_With_ListViews_Count_Measure
- When_MultipleSelectionWithoutItemClick_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
- When_NoSelectionWithItemClick_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
- ProgressRing_IsEnabled_Running_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220
- ProgressRing_Visibility_Collapsed_UITests_Windows_UI_Xaml_Controls_ProgressRing_WindowsProgressRing_GH1220
ios-Snap: 57 changed over 1058
🚨🚨 Comparison Details (first 20) 🚨🚨
- Brushes_ImageBrushWithScaleTransform_Uno_UI_Samples_UITests_ImageBrushTestControl_ImageBrushWithScaleTransform
- ContentControl_ContentControl_UnsetContent_GenericApp_Views_Content_UITests_ContentControlTestsControl_ContentControl_UnsetContent
- NavigationView_MUXControlsTestApp_NavigationViewMinimalPage_MUXControlsTestApp_NavigationViewMinimalPage
- Brushes_RectangleStretchFill_Uno_UI_Samples_UITests_ImageBrushTestControl_RectangleStretchFill
- Icons_UITests_Shared_Windows_UI_Xaml_Controls_BitmapIconTests_BitmapIcon_Foreground_UITests_Shared_Windows_UI_Xaml_Controls_BitmapIconTests_BitmapIcon_Foreground
- ListView_ListViewGroupedChanging_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewGroupedChanging
- NavigationView_MUXControlsTestApp_PaneLayoutTestPage_MUXControlsTestApp_PaneLayoutTestPage
- SwipeControl_MUXControlsTestApp_SwipeControlPage2_MUXControlsTestApp_SwipeControlPage2
- TextBlock_TextBoxSizeChanging_Uno_UI_Samples_Content_UITests_TextBlockControl_TextBoxSizeChanging
- Brushes_ImageBrushWithCompositeTransform_Uno_UI_Samples_UITests_ImageBrushTestControl_ImageBrushWithCompositeTransform
- Grid_Grid_DataBound_ColumnRow_Definitions_Uno_UI_Samples_Content_UITests_GridTestsControl_Grid_DataBound_ColumnRow_Definitions
- NavigationView_MUXControlsTestApp_NavigationViewBlankPage1_MUXControlsTestApp_NavigationViewBlankPage1
- NavigationView_MUXControlsTestApp_NavigationViewCompactPaneLengthTestPage_MUXControlsTestApp_NavigationViewCompactPaneLengthTestPage
- NavigationView_MUXControlsTestApp_NavigationViewCustomThemeResourcesPage_MUXControlsTestApp_NavigationViewCustomThemeResourcesPage
- NavigationView_MUXControlsTestApp_NavigationViewRS4Page_MUXControlsTestApp_NavigationViewRS4Page
- Brushes_ImageBrushStretch_Uno_UI_Samples_UITests_ImageBrushTestControl_ImageBrushStretch
- Clipping_SamplesApp_Windows_UI_Xaml_Clipping_XamlButtonWithClipping_Scrollable_SamplesApp_Windows_UI_Xaml_Clipping_XamlButtonWithClipping_Scrollable
- ListView_ListViewHeaderFooter_ImplicitlyBinded_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewHeaderFooter_ImplicitlyBinded
- Brushes_ImageBrush_Stretch_None_Uno_UI_Samples_UITests_ImageBrushTestControl_ImageBrush_Stretch_None
- Focus_UITests_Windows_UI_Xaml_FocusTests_Focus_FocusCycle_UITests_Windows_UI_Xaml_FocusTests_Focus_FocusCycle
skia-gtk-screenshots: 67 changed over 2224
🚨🚨 Comparison Details (first 20) 🚨🚨
- Focus_FocusVisual_Properties.png-dark
- BorderImageBrushRelativeTransform.png-dark
- Buttons.png-dark
- ImageBrush_SameWithDelay.png
- ButtonClippingTestsControl.png-dark
- ButtonClippingTestsControl.png
- ClipboardTests.png-dark
- BorderImageBrushRelativeTransform.png
- Buttons.png
- DisplayInformation.png-dark
- Focus_FocusVisual_Properties.png
- ClipboardTests.png
- ImageBrushAlignmentXY2.png-dark
- TransformToVisual_Simple.png-dark
- TransformToVisual_Simple.png
- Popup_Simple.png-dark
- Popup_Simple.png
- DisplayInformation.png
- ImageBrush_SameWithDelay.png-dark
- Popup_HVAlignments.png-dark
skia-linux-screenshots: 68 changed over 2224
🚨🚨 Comparison Details (first 20) 🚨🚨
- BorderImageBrush.png-dark
- CalendarView_Theming.png-dark
- DropDownButtonPage.png-dark
- Buttons.png-dark
- Buttons.png
- CompositionEffectBrush.png-dark
- CompositionEffectBrush.png
- Examples.png
- BorderImageBrushRelativeTransform.png-dark
- ClipboardTests.png
- DoubleImageBrushInList.png-dark
- DoubleImageBrushInList.png
- ImageBrushInList.png-dark
- ImageBrushInList.png
- Gamepad_CurrentReading.png-dark
- Gamepad_CurrentReading.png
- Image_UseTargetSize.png-dark
- Image_UseTargetSize.png
- BorderImageBrushRelativeTransform.png
- Gamepad_Enumeration.png-dark
skia-windows-screenshots: 64 changed over 2224
🚨🚨 Comparison Details (first 20) 🚨🚨
- AppWindowPositionAndSize.png-dark
- Focus_FocusVisual_Properties.png-dark
- AppWindowPositionAndSize.png
- DisplayInformation.png-dark
- DisplayInformation.png
- DropDownButtonPage.png-dark
- DropDownButtonPage.png
- Gamepad_Enumeration.png-dark
- Gamepad_Enumeration.png
- ButtonClippingTestsControl.png
- Buttons.png-dark
- CalendarView_Theming.png-dark
- CalendarView_Theming.png
- Buttons.png
- ClipboardTests.png-dark
- ClipboardTests.png
- ColorPickerSample.png-dark
- ColorPickerSample.png
- Examples.png-dark
- Examples.png
wasm: 455 changed over 1044
🚨🚨 Comparison Details (first 20) 🚨🚨
- MUXControlsTestApp.NavigationViewMenuItemStretchPage
- MUXControlsTestApp.NavigationViewStretchPage
- MUXControlsTestApp.NavigationViewTopNavPage
- SamplesApp.Samples.RoutedEvents.RoutedEventsPage
- SamplesApp.Wasm.Windows_UI_Xaml_Controls.ComboBox.ComboBox_DisplayMemberPath
- SamplesApp.Windows_UI_Xaml.Clipping.DoubleAnimationClipping
- SamplesApp.Windows_UI_Xaml.Clipping.PanelChildrenClipping
- SamplesApp.Windows_UI_Xaml_Controls.ListView.ListViewEmptyGroups
- SamplesApp.Windows_UI_Xaml_Shapes.PathTestsControl.PathCircularInsideEllipse
- UITests.Microsoft_UI_Xaml_Controls.TabViewTests.TabViewBasicPage
- UITests.Shared.Windows_ApplicationModel.Calls.PhoneCallManagerTests
- UITests.Shared.Windows_Devices.Midi.MidiDeviceEnumerationTests
- UITests.Shared.Windows_UI_Input.GestureRecognizerTests.RightTappedTests
- UITests.Shared.Windows_UI_Xaml_Controls.BitmapIconTests.BitmapIcon_Foreground
- UITests.Shared.Windows_UI_Xaml_Controls.ListView.ListView_Aligned_Left
- UITests.Shared.Windows_UI_Xaml_Media.Transform.Basics
- UITests.Windows_UI_Xaml_Controls.CommandBar.BackButtonTitle.CommandBar_Frame
- UITests.Windows_UI_Xaml_Controls.CommandBar.CommandBar_Native_Frame
- UITests.Windows_UI_Xaml_Controls.CommandBar.CommandBar_Native_With_AppBarButton_With_Foreground
- UITests.Windows_UI_Xaml_Controls.RelativePanelTests.RelativePanel_AlignHorizontalVerticalCenter
wasm-automated-net9.0-UWP-Default-automated: 26 changed over 1947
🚨🚨 Comparison Details (first 20) 🚨🚨
- Default_Uno_UI_Samples_Content_UITests_WebView_WebView_AnchorNavigation_Uno_UI_Samples_Content_UITests_WebView_WebView_AnchorNavigation
- ImageStretch_None_Uno_UI_Samples_UITests_ImageTestsControl_Image_Stretch_None
- Automation_UITests_Shared_Windows_UI_Xaml_Automation_AutomationProperties_Name_UITests_Shared_Windows_UI_Xaml_Automation_AutomationProperties_Name
- ListView_ListViewSelectedItems_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewSelectedItems
- Default_StrokeThickness_MyRect
- ListView_SelectedItems_SamplesApp_Windows_UI_Xaml_Controls_ListView_ListViewSelectedItems
- Brushes_Uno_UI_Samples_UITests_ImageBrushTestControl_Ellipse_Uno_UI_Samples_UITests_ImageBrushTestControl_Ellipse
- Expander_WinUIExpanderPage_UITests_Shared_Microsoft_UI_Xaml_Controls_ExpanderTests_WinUIExpanderPage
- Default_StrokeThickness_MyPath
- Brushes_BorderImageBrush_Uno_UI_Samples_UITests_ImageBrushTestControl_BorderImageBrush
- Default_SamplesApp_Wasm_Windows_UI_Xaml_Controls_ListView_ListView_IsSelected_SamplesApp_Wasm_Windows_UI_Xaml_Controls_ListView_ListView_IsSelected
- Pointers_UITests_Windows_UI_Input_PointersTests_HitTest_GeometryGroup_UITests_Windows_UI_Input_PointersTests_HitTest_GeometryGroup
- MediaPlayerElement_Mini_player_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Minimal
- MediaPlayerElement_Sources_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Sources
- MediaPlayerElement_Using_3gp_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_3gp_Extension
- MediaPlayerElement_Using_mp3_Audio_only_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Mp3_Extension
- MediaPlayerElement_Using_ogg_UITests_Shared_Windows_UI_Xaml_Controls_MediaPlayerElement_MediaPlayerElement_Ogg_Extension
- ListView_ListView_With_ListViews_Count_Measure_UITests_Shared_Windows_UI_Xaml_Controls_ListView_ListView_With_ListViews_Count_Measure
- SequentialAnimations_SamplesApp_Windows_UI_Xaml_Media_Animation_SequentialAnimationsPage
- When_NoSelectionWithItemClick_Then_PointersEvents_UITests_Windows_UI_Xaml_Controls_ListView_ListView_Selection_Pointers
wasm-automated-net9.0-UWP-RuntimeTests-0: 0 changed over 1
wasm-automated-net9.0-UWP-RuntimeTests-1: 0 changed over 1
wasm-automated-net9.0-UWP-RuntimeTests-2: 0 changed over 1
wasm-automated-net9.0-WinUI-Benchmarks-automated: 0 changed over 1
wasm-automated-net9.0-WinUI-RuntimeTests-0: 0 changed over 1
wasm-automated-net9.0-WinUI-RuntimeTests-1: 0 changed over 1
wasm-automated-net9.0-WinUI-RuntimeTests-2: 0 changed over 1

ci: Add macOS desktop runtime tests

8d2e055

chore: Adjust command line

29fb75d

jeromelaban assigned spouliot Jun 27, 2024

Merge branch 'master' into dev/jela/macos-generic-test

2e2b0b5

fix: Fix When_Window_Closed_Is_Handled on macOS/skia

0ea57fa

fix(tests): When_Copy_Paste on macOS/skia

dac31e8

github-actions bot added the area/skia ✏️ Categorizes an issue or PR as relevant to Skia label Nov 3, 2024

spouliot added 6 commits November 3, 2024 19:05

fix(tests): Check_FontFallback_Shaping on macOS/skia

6f79a81

fix(tests): When_Ctrl_A on macOS/skia

3d19d61

fix(tests): When_Ctrl_Backspace on macOS/skia

8fc014a

fix(tests): When_Ctrl_Delete on macOS/skia

8547cbd

fix(tests): When_Ctrl_Delete_Undo_Redo on macOS/skia

3e1c56c

fix(tests): When_Ctrl_End_ScrollViewer_Vertical_Offset on macOS/skia

6acb0cd

spouliot added 2 commits November 4, 2024 09:55

fix(tests): When_Ctrl_Home_End on macOS/skia

ff2386c

fix(tests): When_Cut_Paste on macOS/skia

d5f60ec

fix(tests): Fix several Given_TextBox tests on macOS/skia

7e21bee

spouliot linked an issue Nov 4, 2024 that may be closed by this pull request

Run Skia macOS Runtime Tests in CI #16270

Closed

spouliot added 6 commits November 4, 2024 13:18

fix(tests): Fix When_Undo_Redo_Keyboard_Basic on macOS/skia

ba5867b

fix(tests): Fix When_Selection_With_Keyboard_NoMod_Ctrl_And_Shift on …

2316d6c

…macOS/skia

fix(tests): Fix When_Scrolling_Updates_After_Backspace on macOS/skia

20df9bd

fix(tests): Fix When_Paste_While_Pointer_Held on macOS/skia

647a7ac

fix(tests): Tolerate 2 pixels diff (happens on CI) for Check_FontFall…

431d124

…back_Shaping

Merge branch 'master' into dev/jela/macos-generic-test

313b0e4

spouliot added 2 commits November 4, 2024 16:38

fix(tests): Fix When_IsTextSelectionEnabled_Keyboard_SelectAll_Copy o…

10e637e

…n macOS/skia

fix(tests): Fix When_Large_List_Scroll_To_End_Then_Back_Up_TryClick o…

8be8374

…n macOS/skia

chore: restore extra > at the end of XML since it fails without it

1e19156

spouliot added 2 commits November 5, 2024 17:04

Merge branch 'master' into dev/jela/macos-generic-test

824ecbf

chore: fix xml comment

2a6a7f9

spouliot marked this pull request as ready for review November 5, 2024 22:20

MartinZikmund approved these changes Nov 6, 2024

View reviewed changes

spouliot merged commit d1b8399 into master Nov 6, 2024
110 checks passed

spouliot deleted the dev/jela/macos-generic-test branch November 6, 2024 14:20

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ci: Add macOS desktop runtime tests #17333

ci: Add macOS desktop runtime tests #17333

jeromelaban commented Jun 27, 2024

unodevops commented Jun 27, 2024

unodevops commented Jun 27, 2024

unodevops commented Jun 27, 2024

unodevops commented Jun 27, 2024

unodevops commented Nov 3, 2024

unodevops commented Nov 3, 2024

unodevops commented Nov 3, 2024

spouliot commented Nov 3, 2024

unodevops commented Nov 3, 2024

spouliot commented Nov 3, 2024

spouliot commented Nov 3, 2024

ramezgerges commented Nov 3, 2024

Youssef1313 commented Nov 3, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 5, 2024

unodevops commented Nov 5, 2024

unodevops commented Nov 6, 2024

unodevops commented Nov 6, 2024

nventive-devops commented Nov 6, 2024

ci: Add macOS desktop runtime tests #17333

ci: Add macOS desktop runtime tests #17333

Conversation

jeromelaban commented Jun 27, 2024

PR Type

What is the current behavior?

What is the new behavior?

PR Checklist

Other information

unodevops commented Jun 27, 2024

unodevops commented Jun 27, 2024

unodevops commented Jun 27, 2024

unodevops commented Jun 27, 2024

unodevops commented Nov 3, 2024

unodevops commented Nov 3, 2024

unodevops commented Nov 3, 2024

spouliot commented Nov 3, 2024

screenshot1.png

screenshot2.png

unodevops commented Nov 3, 2024

spouliot commented Nov 3, 2024

Screenshot

spouliot commented Nov 3, 2024

ramezgerges commented Nov 3, 2024

Youssef1313 commented Nov 3, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 4, 2024

unodevops commented Nov 5, 2024

unodevops commented Nov 5, 2024

unodevops commented Nov 6, 2024

unodevops commented Nov 6, 2024

nventive-devops commented Nov 6, 2024