### Details:
 - Added indirect inputs support for SDPA kernel
 - Added setter for causal flag for ScaledDotProductAttention operation
- Added `ov::intel_gpu::hint::enable_sdpa_optimization` to
`ov::supported_properties` list
- Removed unused `TARGET_SEQ_LEN_BLOCK_SIZE > 1` check from kernel for
single token processing
 - Minor refactoring
- Added `OV_GPU_EnableSDPA` debug option (which allows to force SDPA
kernel for any ScaledDotProductAttention operation _(=1)_ / or
completely disable SDPA kernel _(=0)_, ignoring
`ov::intel_gpu::hint::enable_sdpa_optimization` property)

### Tickets:
 - *CVS-141213*

…ith TF framework (openvinotoolkit#24640)

Fix for TEST_DEVICE=CPU comparison of float16 infinite values

### Details:
- Introduced specialization for conversion float16->float32 in the CPU
plugin
 - xfail in layer tests is disabled for CPU device

### Tickets:
 - *24245*

…kit#24691)

LNL does not support 8 as subgroup size. It need to check before
compiling fc_imad shape agnostic kernel.

### Details:
- *Set subgroup size to 16 if simd8 is not supported in the target
device.*

### Details:
 - Coverity Fix as a line of the code is not reachable 
- Remove the line of dead code and add different log message for 3
different possible return

### Tickets:
 - E-125476

…otoolkit#24679)

Add a note about swap according to the comment
openvinotoolkit#24445 (comment)

---------

Co-authored-by: Tatiana Savina <[email protected]>

### Details:
 - *[CPU] [AARCH64] jit gelu erf*

### Tickets:
 - *CVS-138192*

### Details:
 - Remove legacy test util func
 - *...*

### Tickets:
 - [CVS-128261](https://jira.devtools.intel.com/browse/CVS-128261)

…ed functional test for the op. (openvinotoolkit#24611)

This is a follow up to openvinotoolkit#23955

### Details:
 - Added functional test for ROI Align Rotated
- Fixed a "bug" with wrong batch index inside cl kernel revealed by
functional test for ROI Align Rotated.

### Tickets:
 - *[141877](https://jira.devtools.intel.com/browse/CVS-141877)*

… env (openvinotoolkit#24494)

### Details:
 - *Fix broken url link*
 - *Remove unnecessary step in Linux build env*

### Tickets:
 - *N/A*

…inotoolkit#24690)

During the elimination of dependencies from `beam_idx` input and
`ReadValue`(s), we are replacing them by the new PA-related inputs and
sub-expressions dependent on other remaining inputs. In such
replacements we need to guarantee matching shape and element type of old
and new nodes. Before this PR it was not guaranteed for shape and
sometimes a scalar was replaced by a shape of rank 1 that led to errors
like `'start' input is not a scalar`. Now the shape is aligned.

---------

Co-authored-by: Ivan Tikhonov <[email protected]>
Co-authored-by: Ilya Lavrenov <[email protected]>

### Details:
Handled a case when "Other" input to MatMul is 1D


### Tickets:
 - *CVS-141638*

### Details:
- During investigation I found out that it hangs in AUTO plugin but with
directly specified CPU plugin passes.

### Tickets:
 - CVS-141744

…24320)

### Details:
 - *Exception handling: exception message logging*

### Tickets:
- *NotSupported exception can have message, let's display it. For
example this ticket will be clear in this case: CVS-139934*
 - *Part of CVS-142409*

…vinotoolkit#24719)

### Details:
 - *item1*
 - *...*

### Tickets:
 - *ticket-id*

### Details:
 - *Enable select 5d in cl kernel*
 - *Added basic unit test for select 5d*

### Tickets:
 - *140122*

### Details:
 - when tile_size < vector_size then JTIMES == 0

### Tickets:
 - 142398

…kit#24718)

### Details:
This PR moves Windows Conditional Compilation build to a self-hosted
runner in Azure with 32 cores and 128 GB of RAM

### Details:
 - *item1*
 - *...*

### Tickets:
 - *ticket-id*

### Details:
- *Transferring RoPE operation and transformations for subsequent reuse
in GPU plugin*

…penvinotoolkit#24704)

### Details:
 - *reduce post ops only support f32 precision*

### Tickets:
 - *CVS-142322*
 
### PR for Release:
 - *openvinotoolkit#24724

### Details:
 - Port of openvinotoolkit#24703
- The issue that was present on the release branches does not affect the
master branch yet but it could if, for example, a new folder is added to
the cache path.

### Tickets:
 - *142372*

### Details:
 - *[CPU] [ARM] jit gelu tanh*

### Tickets:
 - *CVS-138293*

### Tickets:
 - *140542*

…penvinotoolkit#24705)

### Details:
- *To align newly added behavior tests with other plugins,
`OVClassCompiledModelPropertiesDefaultTests` should not be tested with
`HETERO` device, as it is in `intel_cpu` plugin:
https://github.com/openvinotoolkit/openvino/blob/master/src/plugins/intel_cpu/tests/functional/shared_tests_instances/behavior/compiled_model/properties.cpp#L63-L67*

### Tickets:
 - *E-120273*

### Details:
 - *Tensor comparation fix*

…kit#24234)

### Details:
 - *Update loop inst ids instead of getting from prim*

### Tickets:
 - *137277*

### Details:
- *Update reshape's output padding by merging current padding and
input's padding*

### Tickets:
 - *137277*

### Details:
 - *Extend ONNX Frontend with Multinomial-7 operator*


### Tickets:
 - *118986*

---------

Co-authored-by: Andrei Kochin <[email protected]>
Co-authored-by: Katarzyna Mitrus <[email protected]>
Co-authored-by: Georgy Krivoruchko <[email protected]>
Co-authored-by: Piotr Krzemiński <[email protected]>

### Details:
 - Fixed Densify reading implementation
 - Added test for Densify
 - Added test for Dequantize
 - Removed unnecessary model test

### Tickets:
 - 127943

---------

Co-authored-by: Roman Kazantsev <[email protected]>

### Details:
 - *Extend Qwen Rope Fusion*
- *PR to 2024.2 release
openvinotoolkit#24727
- *Migrate from original PR
openvinotoolkit#24725

### Tickets:
 - *CVS-142523*

### Details:
- Parse logic from
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/kernels/image/adjust_saturation_op.cc
to openVINO ops

### Tickets:
 - openvinotoolkit#24034

---------

Co-authored-by: Roman Kazantsev <[email protected]>

…24759)

**Details:** Mark new operations for latest release and unmark old ones.

**Ticket:** TBD

Signed-off-by: Kazantsev, Roman <[email protected]>

…lkit#24758)

ze_device_properties_t has pNext pointer and if it's not nullptr then
it's assumed that it points to a different structure. pNext being
uninitialized can lead to a crash during zeDeviceGetProperties.

Docs version update to 2024.2

…4636)

This change was reverted by
openvinotoolkit/oneDNN#230 because performance
degradation.

Degradation happens because ACL kernel was not selected due to
convolution check.
It was discussed with ACL team that this check could be removed and ACL
team removed this check in oneDNN.
Then I deleted this check in oneDNN fork:
openvinotoolkit#24422

Since the check does not prevent us from selecting ACL kernel, we may
remove custom kernel again.

oneDNN PR: openvinotoolkit/oneDNN#251

CVS-142130

TODO:
- [x] do performance check

…olkit#23903)

### Details:
 - *GroupNormalization decomposition test*
 - *GroupNormalization tokenization test*
 - *GroupNormalization snippets func test*

### Tickets:
 - *[CVS-136159](https://jira.devtools.intel.com/browse/CVS-136159)*
 - *[CVS-137359](https://jira.devtools.intel.com/browse/CVS-137359)*

…otoolkit#23428)

### Details:
 - *item1*
 - *...*

### Tickets:
 - *ticket-id*

### Details:
 - Fix coverity 1544154

### Tickets:
 - CVS-140934

### Details:
Handle the case when 2nd input of Transpose op is empty

### Tickets:
openvinotoolkit#23950

…kit#24755)

### Details:
 - *[LPT] EliminateFakeQuantizeTransformation: bf16 support*

### Tickets:
 - *CVS-138910*

### Details:
This PR is a copy of
openvinotoolkit#24757 from release
branch, it includes:
- Enabled SDPA by default
- Updated SDPA decomposition rule to cover only well-checked cases
- Updated functional tests accordingly

### Details:
 - *item1*
 - *...*

### Tickets:
 - *CVS-134419*

…vinotoolkit#24625)

### Details:
- Fixed crash & accuracy issue in beam search scenario when initial
input is not batched

### Tickets:
 - 140755

…inotoolkit#24761)

### Details:
 - Reduce the condition for not-using usm-host input buffer
- This is to reduce the overhead in next-gen GPU performance where
usm_host is the input buffer

### Tickets:
 - 141493

…it#24606)

### Details:
- Windows std::wstring convert to std::string some unicode will be ???,
such as L"unicode_Яㅎあ" -> "unicode_???"

### Tickets:
 - CVS-141444
 - CVS-141729

---------

Signed-off-by: Zhai, Xuejun <[email protected]>

### Details:
Add tests for the SPDAToPagedAttention transformation to Precommit
1) Check if PagedAttentionExtension node appeared in the model after the
transformation
2) Check 2 last dimensions of 'key_cache.' and 'value_cache.' inputs to
be static.

### Tickets:
 - [CVS-138943](https://jira.devtools.intel.com/browse/CVS-138943)

Signed-off-by: Andrii Staikov <[email protected]>

SharedPtr mutual reference fix
### Details:
- use lambda function replacing "Return" function of Gmock in ON_CALL
for *mockIExeNet.get()
- use lambda function replacing "Return" function of Gmock in ON_CALL
for *mockIExeNetActual.get()

"Retrun" function would cause increment of use account of
inferReqInternal and inferReqInternalActual, thereby causing mutual
reference of SharedPtr between mockIExeNet and inferReqInternal or
mockIExeNetActual and inferReqInternalActual.

### Ticket:
   - [CVS-134423](https://jira.devtools.intel.com/browse/CVS-134423)

### Details:
 - *item1*
 - *...*

### Tickets:
 - *136887*

### Tickets:
 - *141574*

…OV developer experience (openvinotoolkit#24763)

### Details:

As a result, you can use this code for most of your needs:

- in a Jupiter notebook
- as a cmd tool
- with model weights being far away

```
def configure_visualizer(enable=True, max_const_elements=7):
    # parameter max_const_elements manipulates the number of first elements of a constant that will be serialized
    # to svg. Put 0 if the model is on a share
    import os
    envs_to_set = [
        'OV_VISUALIZE_TREE_IO',
        'OV_VISUALIZE_TREE_OUTPUT_SHAPES',
        'OV_VISUALIZE_TREE_OUTPUT_TYPES',
        'OV_VISUALIZE_TREE_EDGE_LABELS',
        # symbolic information and partial values
        'OV_VISUALIZE_APPLY_SYMBOLIC_PROPAGATION',
        'OV_VISUALIZE_PARTIAL_VALUES_AND_LABELS'
    ]
    for e in envs_to_set:
        os.environ[e] = '1' if enable else '0'
    os.environ["OV_VISUALIZE_TREE_CONST_MAX_ELEMENTS"] = str(max_const_elements) if enable else "7"


def serialize_model_to_svg(model, output_name='serialized_model.svg'):
    from openvino.runtime.passes import VisualizeTree
    configure_visualizer(True)
    VisualizeTree(output_name).run_on_model(model)
    configure_visualizer(False)


def convert_model_to_svg(input_name, output_name=None):
    import openvino as ov
    core = ov.Core()
    model = core.read_model(input_name)
    if output_name is None:
        output_name = os.path.splitext(os.path.basename(input_name))[0] + '.svg'
    serialize_model_to_svg(model, output_name)


if __name__ == "__main__":
    import sys, os

    arguments = sys.argv[1:]
    if len(arguments) not in [1, 2]:
        print(f"Usage {sys.executable} {__file__} /path/to/model [output_file_name.svg]")
        sys.exit(1)
    output_file = os.path.splitext(os.path.basename(arguments[0]))[0] + '.svg' if len(arguments) == 1 else arguments[1]
    convert_model_to_svg(arguments[0], output_file)
```

…otoolkit#24379)

### Details:
 - SliceToStridedSlice was moved from MOC to Common transformations.
 - Updated RoPE fusion patterns
 - 2 new transformations:  EliminateSlice, SliceSequenceToSingleSlice
- Updated EliminateStridedSlice transformation to support int32_max
case, deleted transformation duplicate from CPU
 - Added new unit tests

Tested locally with these models:

- [x] Means that Model compilation passed, and all RoPE related
transformations were applied in the same order
- [x] hf-internal-testing/tiny-random-StableLmForCausalLM
- [x] hf-internal-testing/tiny-random-FalconForCausalLM
- [x] hf-internal-testing/tiny-random-Starcoder2ForCausalLM
- [x] hf-internal-testing/tiny-random-LlamaForCausalLM
- [x] hf-internal-testing/tiny-random-GPTNeoXForCausalLM
- [x] hf-internal-testing/tiny-random-GPTJForCausalLM
- [x] hf-internal-testing/tiny-random-CodeGenForCausalLM
- [x] hf-internal-testing/tiny-random-MistralForCausalLM
- [x] hf-internal-testing/tiny-random-PhiForCausalLM
- [x] Qwen/Qwen1.5-7B
- [x] THUDM/chatglm3-6b
- [x] EleutherAI/gpt-neox-20b
- [x] google/gemma-2b-it
- [x] EleutherAI/gpt-j-6b
- [x] meta-llama/Meta-Llama-3-8B
- [x] mistralai/Mistral-7B-v0.1

### Tickets:
 - *CVS-126971*

…ns (openvinotoolkit#24771)

### Details:
Disable EliminateSqueeze/EliminateUnsqueeze passes in
SymbolicOptimizations

### Tickets:
 - *CVS-141814*

---------

Co-authored-by: Evgenya Nugmanova <[email protected]>
Co-authored-by: Evgenya Nugmanova <[email protected]>

…file (openvinotoolkit#24782)

### Tickets:
 - *130965*

…lkit#24525)

### Details:
- *United `LoopEndStatic` and `LoopEndDynamic` into one node `LoopEnd`
to avoid extra conditions in the code and improve performance since some
pointer data shifts might be known and compiled in JIT code*
- *Removed dynamic aarch64 loop emitters since they don't work anyway
CVS-141550*
- *Added support dynamism to `IdentifyBuffers` and
`DefineBufferClusters`. It's not efficient algorithm since we don't know
exact values of data pointer shifts and cannot be sure that they will be
proportionally in runtime. It should be implemented as the separate
feature based on some judgments, for example*

### Tickets:
 - *141268*


### Prerequisites:
- *openvinotoolkit#21922

[Snippets] Renamed BufferID to BufferRegisterGroup

[Snippets] Changed allocation shape on size

[Snippets] Added Buffer cluster_ID

[Snippets][Tests] Fixed build insert_load_store test

[Snippets] Splited SolveBufferMemory into static and dynamic logic

[Snippets] Rewrote ComputeBufferAllocationSize::get_allocation_size

[Snippets] Added synamism support to InitBuffersDefault

[Snippets][Tests] Added tests for clusters

[Snippets] Added buffer_expressions to ComputeBufferAllocationSize

[Snippets] Added  to LoopInfo for splitted loops:

[Snippets] Removed copy from UpdateLoopInfo

[Snippets] Moved UpdateLoopInfo to RunimeConfigurator

[Snippets] Add dynamic buffers support to Configurator

[Snippets] Fixed Reduce decomp: add shape infer for outputs

[snippets] Fixed broadcast_merge_dim in shape inference

[Snippets][CPU][Tests] Enabled dynamic Softmax tests

[Snippets] Removed useless function calculate_size

[Snippets][CPU][Tests] Enabled dynamic reduce test

[Snippets] Small fixes in solve_buffer_memory for dynamic nodes

[CPU][Snippets] Removed useless emitters LoadConvert and StoreConvert

[Snippets] Added missed consumers cloning

[Snippets][CPU] Added buffer offsets to call_args

[Snippets][CPU] Added dynamic offsets support to load and store emitters

[CPU][UnitTests} Fixed build

[Snippets][AArch64] Fixed build

[Snippets] Small fixes