From fb9ae906010569619255727cf9ae8d29c7f3fae3 Mon Sep 17 00:00:00 2001 From: Zihan <32484940+wzh4464@users.noreply.github.com> Date: Mon, 17 Jun 2024 13:44:29 +0800 Subject: [PATCH 1/5] =?UTF-8?q?docs:=20=E8=AF=81=E6=98=8E=E4=BC=98?= =?UTF-8?q?=E5=8C=96=E7=9B=AE=E6=A0=87=E5=92=8Csvd=E7=9A=84=E8=81=94?= =?UTF-8?q?=E7=B3=BB?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- cocluster_note/Cocluster.md | 31 +++++++++++++++++++++++++------ 1 file changed, 25 insertions(+), 6 deletions(-) diff --git a/cocluster_note/Cocluster.md b/cocluster_note/Cocluster.md index d7fc3b9..9c2e24a 100644 --- a/cocluster_note/Cocluster.md +++ b/cocluster_note/Cocluster.md @@ -164,7 +164,6 @@ $$ 那么其解为 - $$ \begin{equation} \begin{cases} @@ -175,10 +174,30 @@ Y = \frac{\sqrt{2}}{2} V_1 $$ 其中, $U_1$ 和 $V_1$ 是 $M$ 前 $k$ 个最大的奇异值对应的左右奇异向量. -### Proof - -拉格朗日函数 $\mathcal{L} = \mathrm{Tr} (X^\top M Y) - \mathrm{Tr} (\Lambda (X^\top X + Y^\top Y - I))$. - -$ \frac{\partial \mathcal{L}}{\partial X} = 0 $, 得到 $M Y = X \Lambda$. +> Proof: +> 拉格朗日函数 $\mathcal{L} = \mathrm{Tr} (X^\top M Y) - \mathrm{Tr} (\frac{1}{2}\Lambda (X^\top X + Y^\top Y - I))$. +> +> $$\mathcal{L} = x_{ji} m_{jk} y_{ki} - \lambda_{ij} x_{kj} x_{ki} - \frac{1}{2}\lambda_{ij} y_{kj} y_{ki} - \frac{1}{2}\lambda_{ij} \lambda_{ij}. $$ +> +> $$ +> \begin{align} +> 0 = \frac{\partial \mathcal{L}}{\partial x_{ab}} &= m_{ak} y_{kb} - \lambda_{ij} \frac{\partial x_{kj} x_{ki}}{\partial x_{ab}} =MY - X\Lambda \\ +> 0 = \frac{\partial \mathcal{L}}{\partial y_{ab}} &= m_{ka} x_{bk} - \lambda_{ij} \frac{\partial y_{kj} y_{ki}}{\partial y_{ab}} =M^\top X - Y\Lambda +> \end{align} +> $$ +> +> $$ +> \begin{align} +> M M^\top (X_1, X_2, \cdots, X_k) &= M M^\top X = M Y \Lambda = X \Lambda^2 \\ +> &= X \text{diag}(\lambda_1^2, \lambda_2^2, \cdots, \lambda_k^2) = (\lambda_1^2 X_1, \lambda_2^2 X_2, \cdots, \lambda_k^2 X_k) +> \end{align} +> $$ +> +> 于是 $X$ 是 $M$ 的前 $k$ 个最大的奇异值对应的左奇异向量. +> 同理可得 $Y$ 是 $M$ 的前 $k$ 个最大的奇异值对应的右奇异向量. + +### 离散情况 + +## Conclusion ## References From dcd93d5077dc498e37066e4fa5284170a027c502 Mon Sep 17 00:00:00 2001 From: Zihan <32484940+wzh4464@users.noreply.github.com> Date: Mon, 17 Jun 2024 17:45:12 +0800 Subject: [PATCH 2/5] sout (cherry picked from commit 131a666fce962900022f21d4377d20a2a5f32091) --- MacOS/SidecarPatcher.md | 22 ++++++++++++++++++++-- 1 file changed, 20 insertions(+), 2 deletions(-) diff --git a/MacOS/SidecarPatcher.md b/MacOS/SidecarPatcher.md index 656e7b4..a518b95 100644 --- a/MacOS/SidecarPatcher.md +++ b/MacOS/SidecarPatcher.md @@ -4,6 +4,7 @@ documentclass: "ctexart" classoption: "UTF8" --- # SidecarPatcher + [**Youtube Tutorial**](https://www.youtube.com/watch?v=YJ4FLFL7nUE) Enables Sidecar on old Mac and iPad for macOS 10.15 Sidecar is disabled on these devices by Apple: `iMac13,1, iMac13,2, iMac13,3, iMac14,1, iMac14,2, iMac14,3, iMac14,4, iMac15,1, iMac16,1, iMac16,2, MacBook8,1, MacBookAir5,1, MacBookAir5,2, MacBookAir6,1, MacBookAir6,2, MacBookAir7,1, MacBookAir7,2, MacBookPro9,1, MacBookPro9,2, MacBookPro10,1, MacBookPro10,2, MacBookPro11,1, MacBookPro11,2, MacBookPro11,3, MacBookPro11,4, MacBookPro11,5, MacBookPro12,1, Macmini6,1, Macmini6,2, Macmini7,1, MacPro5,1, MacPro6,1` @@ -13,28 +14,45 @@ You can get the model identifier of your iPad by using this app: [Mactracker (iO This script disables this blacklist in macOS. This does NOT patch the iPadOS root system, jailbreaking is not required. This is a command line script. If you want GUI application, try [free-sidecar](https://github.com/ben-z/free-sidecar) by ben-z. Tested on macOS 10.15~10.15.4. Doesn't work with macOS 11.0. + ## How to patch + It is very unstable. There are many known issues. Read [Issues](https://github.com/pookjw/SidecarPatcher/issues). Please use this at your own risk. + 1. Backup `/System/Library/PrivateFrameworks/SidecarCore.framework` folder. This script doesn't provide original system file. 2. Install the latest version of **Command Line Tools** from [Apple Developer website](https://developer.apple.com/download/more/). + - Requires Apple Developer Account, you can use a free-tier developer account. + 3. Disable **System Integrity Protection**. [How to turn off System Integrity Protection on your Mac](https://www.imore.com/how-turn-system-integrity-protection-macos). After disabling **System Integrity Protection**, reboot into normal macOS. + - To check SIP is disabled: `csrutil status` + 4. Open **Terminal** application and clone this repository by running this command: `git clone https://github.com/pookjw/SidecarPatcher` 5. Run main.swift: `sudo swift SidecarPatcher/main.swift` + - You will need to enter your macOS password. - Ignore **warnings**. If you encounter error and you don't know how to fix, upload a log to [Issue](https://github.com/pookjw/SidecarPatcher/issues). (I can't reply all issues because I don't know all.) - About xcrun error and crashing many apps after rebooting: [#4](https://github.com/pookjw/SidecarPatcher/issues/4) + ## How to revert + ### Simplest Method (1) + Reinstall your macOS using **macOS Combo Update**. You can download **macOS Combo Update** from [here](https://support.apple.com/downloads/macos). For example, if you're using macOS Catalina 10.15.4, download [macOS Catalina 10.15.4 Combo Update](https://support.apple.com/kb/DL2037?viewlocale=en_US&locale=en_US). It won't erase your data and it will just reinstall the system. + ### Simplest Method (2) + Reinstall your macOS using **Install macOS Catalina.app**. Install it without erasing your disk it won't erase your data and it will just reinstall the system. + ### Using your backup + 1. Disable **System Integrity Protection**. [How to turn off System Integrity Protection on your Mac](https://www.imore.com/how-turn-system-integrity-protection-macos). -To check SIP is disabled: `csrutil status` +To check SIP is disabled: `csrutil status` 2. Run `sudo mount -uw /` command. 3. Copy the original SidecarCore folder: `sudo cp /path/to/original /System/Library/PrivateFrameworks/SidecarCore.framework` + - Make sure you put the right path for SidecarCore `/path/to/original`. + 4. Set permission as 755: `sudo chmod -R 755 /System/Library/PrivateFrameworks/SidecarCore.framework` -5. Reboot. ~~If you want to enable System Integrity Protection again, you can do so now.~~ (Testing #54) +5. Reboot. (Testing #54) From a3bfe275dda87a65db1d2051a8886e14d522de0a Mon Sep 17 00:00:00 2001 From: Zihan <32484940+wzh4464@users.noreply.github.com> Date: Mon, 17 Jun 2024 20:25:58 +0800 Subject: [PATCH 3/5] remove space in path --- CFA/{CFA Rates and Return.md => CFA_Rates_and_Return.md} | 0 ...y.md => CFA_Time_Value_of_Money_in_Fixed_Income_and_Equity.md} | 0 CFA/{Corporate Issuers => Corporate_Issuers}/Breakeven_Point.md | 0 .../Capital_Allocation.md} | 0 CFA/{Corporate Issuers => Corporate_Issuers}/Capital_Structure.md | 0 CFA/{Corporate Issuers => Corporate_Issuers}/Cost_of_Capital.md | 0 .../Financial_Risk_and_Financial_Leverage.md} | 0 .../Operating_Risk_and_Operating_Leverage.md} | 0 .../Total Leverage.md => Corporate_Issuers/Total_Leverage.md} | 0 .../\350\236\215\350\265\204\346\211\213\346\256\265.md" | 0 .../Common-Size-Income-Statement_and_OCI.md" | 0 .../Current_Assets_And_Liabilities.md" | 0 Canada/{Acts needed.md => Acts_needed.md} | 0 ...{Annual report Requirement.md => Annual_report_Requirement.md} | 0 CityU/{Yan's first idea.md => Yan's_first_idea.md} | 0 ...{debug matlab mex on linux.md => debug_matlab_mex_on_linux.md} | 0 ....13.excalidraw.md => Drawing_2023-04-17_20.53.13.excalidraw.md | 0 English/{Not only but also.md => Not_only_but_also.md} | 0 ...14.excalidraw.md => Drawing_2023-06-27_20.59.14.excalidraw.md} | 0 ...37.excalidraw.md => Drawing_2023-07-03_10.53.37.excalidraw.md} | 0 ...37.excalidraw.md => Drawing_2023-10-30_10.43.37.excalidraw.md} | 0 ...k to New Page and Open.md => Add_Link_to_New_Page_and_Open.md} | 0 .../Scripts/Downloaded/{Set Font Family.md => Set_Font_Family.md} | 0 HPC/{GPG on hpc.md => GPG_on_hpc.md} | 0 Linux/{Linux Onedrive.md => Linux_Onedrive.md} | 0 Linux/{SSH GPG.md => SSH_GPG.md} | 0 ...tall vscode without sudo.md => install_vscode_without_sudo.md} | 0 Linux/{umount disks.md => umount_disks.md} | 0 .../\345\256\211\350\243\205_Linux.md" | 0 Love/{BGP signed messages.md => BGP_signed_messages.md} | 0 ... via skim & codegeex.md => open_vscode_via_skim_&_codegeex.md} | 0 .../\350\207\252\345\212\251\347\255\276\345\220\215macOS_app.md" | 0 ...s.md => Approximating_the_inverse_of_a_sum_of_two_matrices.md} | 0 .../Kolmogorov\342\200\231s_extension_theorem.md" | 0 ...51\223\276\345\237\272\346\234\254\345\256\232\347\220\206.md" | 0 ...{Quaternion on Mathematica.md => Quaternion_on_Mathematica.md} | 0 .../{Remove texdoc from latex.md => Remove_texdoc_from_latex.md} | 0 37 files changed, 0 insertions(+), 0 deletions(-) rename CFA/{CFA Rates and Return.md => CFA_Rates_and_Return.md} (100%) rename CFA/{CFA Time Value of Money in Fixed Income and Equity.md => CFA_Time_Value_of_Money_in_Fixed_Income_and_Equity.md} (100%) rename CFA/{Corporate Issuers => Corporate_Issuers}/Breakeven_Point.md (100%) rename CFA/{Corporate Issuers/Capital Allocation.md => Corporate_Issuers/Capital_Allocation.md} (100%) rename CFA/{Corporate Issuers => Corporate_Issuers}/Capital_Structure.md (100%) rename CFA/{Corporate Issuers => Corporate_Issuers}/Cost_of_Capital.md (100%) rename CFA/{Corporate Issuers/Financial Risk and Financial Leverage.md => Corporate_Issuers/Financial_Risk_and_Financial_Leverage.md} (100%) rename CFA/{Corporate Issuers/Operating Risk and Operating Leverage.md => Corporate_Issuers/Operating_Risk_and_Operating_Leverage.md} (100%) rename CFA/{Corporate Issuers/Total Leverage.md => Corporate_Issuers/Total_Leverage.md} (100%) rename "CFA/Corporate Issuers/\350\236\215\350\265\204\346\211\213\346\256\265.md" => "CFA/Corporate_Issuers/\350\236\215\350\265\204\346\211\213\346\256\265.md" (100%) rename "CFA/\350\264\242\346\212\245/Common-Size-Income-Statement and OCI.md" => "CFA/\350\264\242\346\212\245/Common-Size-Income-Statement_and_OCI.md" (100%) rename "CFA/\350\264\242\346\212\245/\350\265\204\344\272\247\350\264\237\345\200\272\350\241\250/Current Assets And Liabilities.md" => "CFA/\350\264\242\346\212\245/\350\265\204\344\272\247\350\264\237\345\200\272\350\241\250/Current_Assets_And_Liabilities.md" (100%) rename Canada/{Acts needed.md => Acts_needed.md} (100%) rename CityU/{Annual report Requirement.md => Annual_report_Requirement.md} (100%) rename CityU/{Yan's first idea.md => Yan's_first_idea.md} (100%) rename Coding/{debug matlab mex on linux.md => debug_matlab_mex_on_linux.md} (100%) rename Drawing 2023-04-17 20.53.13.excalidraw.md => Drawing_2023-04-17_20.53.13.excalidraw.md (100%) rename English/{Not only but also.md => Not_only_but_also.md} (100%) rename Excalidraw/{Drawing 2023-06-27 20.59.14.excalidraw.md => Drawing_2023-06-27_20.59.14.excalidraw.md} (100%) rename Excalidraw/{Drawing 2023-07-03 10.53.37.excalidraw.md => Drawing_2023-07-03_10.53.37.excalidraw.md} (100%) rename Excalidraw/{Drawing 2023-10-30 10.43.37.excalidraw.md => Drawing_2023-10-30_10.43.37.excalidraw.md} (100%) rename Excalidraw/Scripts/Downloaded/{Add Link to New Page and Open.md => Add_Link_to_New_Page_and_Open.md} (100%) rename Excalidraw/Scripts/Downloaded/{Set Font Family.md => Set_Font_Family.md} (100%) rename HPC/{GPG on hpc.md => GPG_on_hpc.md} (100%) rename Linux/{Linux Onedrive.md => Linux_Onedrive.md} (100%) rename Linux/{SSH GPG.md => SSH_GPG.md} (100%) rename Linux/{install vscode without sudo.md => install_vscode_without_sudo.md} (100%) rename Linux/{umount disks.md => umount_disks.md} (100%) rename "Linux/\345\256\211\350\243\205 Linux.md" => "Linux/\345\256\211\350\243\205_Linux.md" (100%) rename Love/{BGP signed messages.md => BGP_signed_messages.md} (100%) rename MacOS/{open vscode via skim & codegeex.md => open_vscode_via_skim_&_codegeex.md} (100%) rename "MacOS/\350\207\252\345\212\251\347\255\276\345\220\215macOS app.md" => "MacOS/\350\207\252\345\212\251\347\255\276\345\220\215macOS_app.md" (100%) rename Math/{Approximating the inverse of a sum of two matrices.md => Approximating_the_inverse_of_a_sum_of_two_matrices.md} (100%) rename "Math/Kolmogorov\342\200\231s extension theorem.md" => "Math/Kolmogorov\342\200\231s_extension_theorem.md" (100%) rename "Math/Markov \351\223\276\345\237\272\346\234\254\345\256\232\347\220\206.md" => "Math/Markov_\351\223\276\345\237\272\346\234\254\345\256\232\347\220\206.md" (100%) rename Math/{Quaternion on Mathematica.md => Quaternion_on_Mathematica.md} (100%) rename latex/{Remove texdoc from latex.md => Remove_texdoc_from_latex.md} (100%) diff --git a/CFA/CFA Rates and Return.md b/CFA/CFA_Rates_and_Return.md similarity index 100% rename from CFA/CFA Rates and Return.md rename to CFA/CFA_Rates_and_Return.md diff --git a/CFA/CFA Time Value of Money in Fixed Income and Equity.md b/CFA/CFA_Time_Value_of_Money_in_Fixed_Income_and_Equity.md similarity index 100% rename from CFA/CFA Time Value of Money in Fixed Income and Equity.md rename to CFA/CFA_Time_Value_of_Money_in_Fixed_Income_and_Equity.md diff --git a/CFA/Corporate Issuers/Breakeven_Point.md b/CFA/Corporate_Issuers/Breakeven_Point.md similarity index 100% rename from CFA/Corporate Issuers/Breakeven_Point.md rename to CFA/Corporate_Issuers/Breakeven_Point.md diff --git a/CFA/Corporate Issuers/Capital Allocation.md b/CFA/Corporate_Issuers/Capital_Allocation.md similarity index 100% rename from CFA/Corporate Issuers/Capital Allocation.md rename to CFA/Corporate_Issuers/Capital_Allocation.md diff --git a/CFA/Corporate Issuers/Capital_Structure.md b/CFA/Corporate_Issuers/Capital_Structure.md similarity index 100% rename from CFA/Corporate Issuers/Capital_Structure.md rename to CFA/Corporate_Issuers/Capital_Structure.md diff --git a/CFA/Corporate Issuers/Cost_of_Capital.md b/CFA/Corporate_Issuers/Cost_of_Capital.md similarity index 100% rename from CFA/Corporate Issuers/Cost_of_Capital.md rename to CFA/Corporate_Issuers/Cost_of_Capital.md diff --git a/CFA/Corporate Issuers/Financial Risk and Financial Leverage.md b/CFA/Corporate_Issuers/Financial_Risk_and_Financial_Leverage.md similarity index 100% rename from CFA/Corporate Issuers/Financial Risk and Financial Leverage.md rename to CFA/Corporate_Issuers/Financial_Risk_and_Financial_Leverage.md diff --git a/CFA/Corporate Issuers/Operating Risk and Operating Leverage.md b/CFA/Corporate_Issuers/Operating_Risk_and_Operating_Leverage.md similarity index 100% rename from CFA/Corporate Issuers/Operating Risk and Operating Leverage.md rename to CFA/Corporate_Issuers/Operating_Risk_and_Operating_Leverage.md diff --git a/CFA/Corporate Issuers/Total Leverage.md b/CFA/Corporate_Issuers/Total_Leverage.md similarity index 100% rename from CFA/Corporate Issuers/Total Leverage.md rename to CFA/Corporate_Issuers/Total_Leverage.md diff --git "a/CFA/Corporate Issuers/\350\236\215\350\265\204\346\211\213\346\256\265.md" "b/CFA/Corporate_Issuers/\350\236\215\350\265\204\346\211\213\346\256\265.md" similarity index 100% rename from "CFA/Corporate Issuers/\350\236\215\350\265\204\346\211\213\346\256\265.md" rename to "CFA/Corporate_Issuers/\350\236\215\350\265\204\346\211\213\346\256\265.md" diff --git "a/CFA/\350\264\242\346\212\245/Common-Size-Income-Statement and OCI.md" "b/CFA/\350\264\242\346\212\245/Common-Size-Income-Statement_and_OCI.md" similarity index 100% rename from "CFA/\350\264\242\346\212\245/Common-Size-Income-Statement and OCI.md" rename to "CFA/\350\264\242\346\212\245/Common-Size-Income-Statement_and_OCI.md" diff --git "a/CFA/\350\264\242\346\212\245/\350\265\204\344\272\247\350\264\237\345\200\272\350\241\250/Current Assets And Liabilities.md" "b/CFA/\350\264\242\346\212\245/\350\265\204\344\272\247\350\264\237\345\200\272\350\241\250/Current_Assets_And_Liabilities.md" similarity index 100% rename from "CFA/\350\264\242\346\212\245/\350\265\204\344\272\247\350\264\237\345\200\272\350\241\250/Current Assets And Liabilities.md" rename to "CFA/\350\264\242\346\212\245/\350\265\204\344\272\247\350\264\237\345\200\272\350\241\250/Current_Assets_And_Liabilities.md" diff --git a/Canada/Acts needed.md b/Canada/Acts_needed.md similarity index 100% rename from Canada/Acts needed.md rename to Canada/Acts_needed.md diff --git a/CityU/Annual report Requirement.md b/CityU/Annual_report_Requirement.md similarity index 100% rename from CityU/Annual report Requirement.md rename to CityU/Annual_report_Requirement.md diff --git a/CityU/Yan's first idea.md b/CityU/Yan's_first_idea.md similarity index 100% rename from CityU/Yan's first idea.md rename to CityU/Yan's_first_idea.md diff --git a/Coding/debug matlab mex on linux.md b/Coding/debug_matlab_mex_on_linux.md similarity index 100% rename from Coding/debug matlab mex on linux.md rename to Coding/debug_matlab_mex_on_linux.md diff --git a/Drawing 2023-04-17 20.53.13.excalidraw.md b/Drawing_2023-04-17_20.53.13.excalidraw.md similarity index 100% rename from Drawing 2023-04-17 20.53.13.excalidraw.md rename to Drawing_2023-04-17_20.53.13.excalidraw.md diff --git a/English/Not only but also.md b/English/Not_only_but_also.md similarity index 100% rename from English/Not only but also.md rename to English/Not_only_but_also.md diff --git a/Excalidraw/Drawing 2023-06-27 20.59.14.excalidraw.md b/Excalidraw/Drawing_2023-06-27_20.59.14.excalidraw.md similarity index 100% rename from Excalidraw/Drawing 2023-06-27 20.59.14.excalidraw.md rename to Excalidraw/Drawing_2023-06-27_20.59.14.excalidraw.md diff --git a/Excalidraw/Drawing 2023-07-03 10.53.37.excalidraw.md b/Excalidraw/Drawing_2023-07-03_10.53.37.excalidraw.md similarity index 100% rename from Excalidraw/Drawing 2023-07-03 10.53.37.excalidraw.md rename to Excalidraw/Drawing_2023-07-03_10.53.37.excalidraw.md diff --git a/Excalidraw/Drawing 2023-10-30 10.43.37.excalidraw.md b/Excalidraw/Drawing_2023-10-30_10.43.37.excalidraw.md similarity index 100% rename from Excalidraw/Drawing 2023-10-30 10.43.37.excalidraw.md rename to Excalidraw/Drawing_2023-10-30_10.43.37.excalidraw.md diff --git a/Excalidraw/Scripts/Downloaded/Add Link to New Page and Open.md b/Excalidraw/Scripts/Downloaded/Add_Link_to_New_Page_and_Open.md similarity index 100% rename from Excalidraw/Scripts/Downloaded/Add Link to New Page and Open.md rename to Excalidraw/Scripts/Downloaded/Add_Link_to_New_Page_and_Open.md diff --git a/Excalidraw/Scripts/Downloaded/Set Font Family.md b/Excalidraw/Scripts/Downloaded/Set_Font_Family.md similarity index 100% rename from Excalidraw/Scripts/Downloaded/Set Font Family.md rename to Excalidraw/Scripts/Downloaded/Set_Font_Family.md diff --git a/HPC/GPG on hpc.md b/HPC/GPG_on_hpc.md similarity index 100% rename from HPC/GPG on hpc.md rename to HPC/GPG_on_hpc.md diff --git a/Linux/Linux Onedrive.md b/Linux/Linux_Onedrive.md similarity index 100% rename from Linux/Linux Onedrive.md rename to Linux/Linux_Onedrive.md diff --git a/Linux/SSH GPG.md b/Linux/SSH_GPG.md similarity index 100% rename from Linux/SSH GPG.md rename to Linux/SSH_GPG.md diff --git a/Linux/install vscode without sudo.md b/Linux/install_vscode_without_sudo.md similarity index 100% rename from Linux/install vscode without sudo.md rename to Linux/install_vscode_without_sudo.md diff --git a/Linux/umount disks.md b/Linux/umount_disks.md similarity index 100% rename from Linux/umount disks.md rename to Linux/umount_disks.md diff --git "a/Linux/\345\256\211\350\243\205 Linux.md" "b/Linux/\345\256\211\350\243\205_Linux.md" similarity index 100% rename from "Linux/\345\256\211\350\243\205 Linux.md" rename to "Linux/\345\256\211\350\243\205_Linux.md" diff --git a/Love/BGP signed messages.md b/Love/BGP_signed_messages.md similarity index 100% rename from Love/BGP signed messages.md rename to Love/BGP_signed_messages.md diff --git a/MacOS/open vscode via skim & codegeex.md b/MacOS/open_vscode_via_skim_&_codegeex.md similarity index 100% rename from MacOS/open vscode via skim & codegeex.md rename to MacOS/open_vscode_via_skim_&_codegeex.md diff --git "a/MacOS/\350\207\252\345\212\251\347\255\276\345\220\215macOS app.md" "b/MacOS/\350\207\252\345\212\251\347\255\276\345\220\215macOS_app.md" similarity index 100% rename from "MacOS/\350\207\252\345\212\251\347\255\276\345\220\215macOS app.md" rename to "MacOS/\350\207\252\345\212\251\347\255\276\345\220\215macOS_app.md" diff --git a/Math/Approximating the inverse of a sum of two matrices.md b/Math/Approximating_the_inverse_of_a_sum_of_two_matrices.md similarity index 100% rename from Math/Approximating the inverse of a sum of two matrices.md rename to Math/Approximating_the_inverse_of_a_sum_of_two_matrices.md diff --git "a/Math/Kolmogorov\342\200\231s extension theorem.md" "b/Math/Kolmogorov\342\200\231s_extension_theorem.md" similarity index 100% rename from "Math/Kolmogorov\342\200\231s extension theorem.md" rename to "Math/Kolmogorov\342\200\231s_extension_theorem.md" diff --git "a/Math/Markov \351\223\276\345\237\272\346\234\254\345\256\232\347\220\206.md" "b/Math/Markov_\351\223\276\345\237\272\346\234\254\345\256\232\347\220\206.md" similarity index 100% rename from "Math/Markov \351\223\276\345\237\272\346\234\254\345\256\232\347\220\206.md" rename to "Math/Markov_\351\223\276\345\237\272\346\234\254\345\256\232\347\220\206.md" diff --git a/Math/Quaternion on Mathematica.md b/Math/Quaternion_on_Mathematica.md similarity index 100% rename from Math/Quaternion on Mathematica.md rename to Math/Quaternion_on_Mathematica.md diff --git a/latex/Remove texdoc from latex.md b/latex/Remove_texdoc_from_latex.md similarity index 100% rename from latex/Remove texdoc from latex.md rename to latex/Remove_texdoc_from_latex.md From 4bea94f774a3d5cddaf38b7a32a5bcfd6a54aa69 Mon Sep 17 00:00:00 2001 From: Zihan <32484940+wzh4464@users.noreply.github.com> Date: Fri, 21 Jun 2024 00:15:36 +0800 Subject: [PATCH 4/5] review (cherry picked from commit aeaa1570f743d1885fb4c4cbdcbf82bfc863da40) --- .../xie2024StochasticDelayedAdversarial.md | 69 +++++++++++++++++++ 1 file changed, 69 insertions(+) create mode 100644 LiteratureNotes/xie2024StochasticDelayedAdversarial.md diff --git a/LiteratureNotes/xie2024StochasticDelayedAdversarial.md b/LiteratureNotes/xie2024StochasticDelayedAdversarial.md new file mode 100644 index 0000000..dfd120f --- /dev/null +++ b/LiteratureNotes/xie2024StochasticDelayedAdversarial.md @@ -0,0 +1,69 @@ +--- +toc: true +documentclass: "ctexart" +classoption: "UTF8" +zotero-key: EP2FS5DJ +zt-attachments: + - "15307" +title: Stochastic delayed adversarial imitation learning +citekey: xie2024StochasticDelayedAdversarial +--- +# Stochastic delayed adversarial imitation learning + +[Zotero](zotero://select/library/items/EP2FS5DJ) [attachment](file:///Volumes/Mac_Ext/Zotero/storage/RGWXRUN5/SMC24_0429_MS.pdf) + +> [!note] Page 1 +> +> Abstract— +> +> --- +> 实时竞价（RTB）已广泛应用于在线展示广告中，广告主为每个展示机会竞价以展示他们的广告。为了优化广告主的广告效果，RTB中提出了大量的竞价策略，其中大多数旨在通过竞价参数来推导出最佳竞价函数。主流的竞价策略之一是基于实时反馈调整竞价参数，利用强化学习（RL）。然而，RL方法在实际应用中通常会遇到诸如随机延迟等挑战，导致RL竞价策略表现不佳。本文提出了一种名为高效探索的逆向经验重放（BEE）的新框架，该框架利用随机延迟对抗模仿学习（SDAIL）来应对这些挑战。BEE由两个模块组成：辅助探索策略和优先级采样技术。辅助探索策略引入辅助策略，以实现RL训练过程中的高效探索。优先级采样技术结合了两种新的采样方法：逆向优先经验重放（BPER）和关键区域优先经验重放（KPER），协同实现RL模型的有效更新和快速收敛。我们在xiaohongshu.com的工业数据集上进行了大量实验，结果表明，BEE在收敛速度和广告效果方面优于先前的方法，展示了BEE方法的有效性。 +> ^NWTT4BVJaRGWXRUN5p1 + +> [!note] Page 1 +> +> INTRODUCTION +> +> --- +> 在移动社交媒体时代，在线展示广告是新兴广告形式中最重要的一种。据互联网广告局（IAB）报告显示，2022年美国的在线展示广告收入比2021年增长了10.8%，总计2097亿美元[1]。实时竞价（RTB）[2]是一种广泛采用的在线展示广告范式，广告主为每次展示机会竞价，展示机会随后分配给出价最高的广告主。随着RTB的发展，出现了许多竞价策略，通过最大化转化率在广告主指定的预算和关键绩效指标（KPI）约束下提高广告效果。传统上，大多数竞价策略研究将竞价问题表述为线性规划问题，旨在通过竞价参数推导出最佳竞价函数。在主流方法中，一种方法是通过强化学习（RL）根据实时反馈调整竞价参数。RL是一种著名的范式，在实际任务中取得了显著成功[3]，[4]，[5]，并已在RTB中实现了竞价参数的调整。一些基于RL的方法，如USCB[6]、SoRL[7]和CBRL[8]，已被开发以解决RTB中稀疏奖励和在线与离线环境之间不一致的问题。然而，基于RL的方法存在一些限制，包括低效的探索和缓慢的收敛，导致表现不佳甚至在RTB中失败。为了解决RL方法在RTB中面临的挑战，我们提出了一种创新的基于RL的算法，名为高效探索的逆向经验重放（BEE），优化了收集数据的利用率。意识到RL中的数据利用包括环境中的探索和从重放缓冲区中采样经验[9]，BEE结合了两个模块：辅助探索策略和优先级采样技术。这些模块重新定义了RL如何利用数据，提升了广告效果。具体来说，辅助探索策略在早期学习中被引入，以改善探索并加速训练。在训练的初始阶段，智能体通常随机与环境交互，导致累积大量劣质经验，阻碍学习过程。为了解决这一挑战，我们引入了一种辅助策略，可以是基于规则的方法或简单预训练的网络，在决策时间歇性地替代智能体的策略。通过这样做，我们能够更高效地探索特征空间。借助辅助探索策略的优势，我们能够收集到更多高质量的经验，从而促进增强学习。在优先级采样技术的部署中，我们提出了两种新的采样方法，以更好地利用存储的数据，实现更快的收敛。根据RL中的贝尔曼方程，经验的Q值取决于其后继的Q值。如果采样策略忽略了后续经验Q值估计的精度，可能会导致Q网络的错误更新。为了应对这个问题，逆向经验重放（RER）[10]被提出作为解决方案。RER通过逆序采样经验并执行更新来解决问题。然而，这种方法重新引入了经验之间的时间相关性，这是一种对神经网络性能有害的数据特征。因此，我们将RER与优先级经验重放（PER）结合，提出了一种新的采样策略，名为逆向优先经验重放（BPER）。BPER对轨迹后段的经验赋予高重要性，导致Q网络的更快收敛。此外，RTB中的高维特征空间在高效采样方面存在挑战，因其高维性、大量信息和特征分布不均。这些因素使得快速获取有价值的经验变得困难，从而增加了算法的训练难度。为了解决这一问题，我们提出了关键区域优先经验重放（KPER），将特征空间划分为关键区域，在这些区域内的经验被高优先级采样。借助KPER，智能体能够更高效地学习关键区域的有意义经验，从而在更少的更新中取得更好的表现。为了证明我们提出的BEE算法的有效性，我们在xiaohongshu.com的大规模工业数据集上进行了评估。实验结果表明，BEE在收敛速度和广告表现方面优于先前的方法。我们总结了本文的主要贡献如下：我们提出了BEE算法，在满足曝光和利润率约束的同时最大化转化率。我们设计了两个新模块，辅助探索策略和优先级采样技术，这些模块促进了高维特征空间中的高效训练，使得精确学习和快速收敛成为可能，从而提升广告表现。我们在xiaohongshu.com的实际工业数据集上进行了实证评估，展示了BEE算法相对于先前方法的优越性。 +> ^Z22XFZSLaRGWXRUN5p1 + +> [!note] Page 2 +> +> Backward Prioritized Experience Replay +> +> --- +> Seems not novel +> ^HWJ37REFaRGWXRUN5p2 + +> [!note] Page 2 +> +> partition +> +> --- +> How to partition +> ^B37HEA6WaRGWXRUN5p2 + +> [!note] Page 2 +> +> RELATED WORKS +> +> --- +> 基于强化学习的竞价：已经提出了几种成功的基于RL的方法用于RTB。在[13]中，竞价问题被表述为一个马尔可夫决策过程（MDP），通过调整展示级别的竞价价格进行在线决策。[14]提出了一种基于RL的方法，直接确定最终竞价，提高了RTB环境中的鲁棒性。在[15]中，设计了一个奖励网络，以学习合适的奖励，克服误导性即时奖励的问题。USCB[6]将约束竞价抽象为一个顺序参数调整问题，通过奖励塑形决定竞价参数。为了应对在线和离线环境之间的不一致，提出了SoRL[7]。SoRL设计了一种探索策略与在线环境交互，并通过方差抑制方法训练竞价代理。[8]基于贝叶斯RL提出了CBRL，以解决非静态广告市场中的ROI约束竞价问题。 +> ^BV76IXBEaRGWXRUN5p2 + +> [!note] Page 2 +> +> Reinforcement Learning-based Bidding +> +> --- +> not complete +> ^HLE9TMSDaRGWXRUN5p2 + +> [!note] Page 8 +> +> Tom Schaul, John Quan, Ioannis Antonoglou, and David Silver. Prioritized experience replay. arXiv preprint arXiv:1511.05952, 2015 +> +> --- +> ICLR 2016 +> ^8SZZVPMRaRGWXRUN5p8 From 728db2112c44f7d232a7aec5714de78d08c63006 Mon Sep 17 00:00:00 2001 From: Zihan <32484940+wzh4464@users.noreply.github.com> Date: Fri, 21 Jun 2024 17:27:10 +0800 Subject: [PATCH 5/5] feat: Add instructions for adding a virtual monitor on Windows 10 and higher --- daily_logs/windows_virtual_monitor.md | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) create mode 100644 daily_logs/windows_virtual_monitor.md diff --git a/daily_logs/windows_virtual_monitor.md b/daily_logs/windows_virtual_monitor.md new file mode 100644 index 0000000..382b153 --- /dev/null +++ b/daily_logs/windows_virtual_monitor.md @@ -0,0 +1,16 @@ +# Windows Virtual Monitor + +Here is the procedure to add a virtual monitor to your system (Windows 10 and Higher!) + +Download our virtual display driver from +Unpack the zip file to an empty folder, e.g. c:\temp\usbmmidd_v2 +Make sure you read the License.txt file as with any other software product +Open a command prompt window as Administrator (you cannot add a device to your system unless you "Run As Administrator") +Run the following commands: + +```bash + cd c:\temp\usbmmid_v2 # (or whatever destination folder you chose) + deviceinstaller64 install usbmmidd.inf usbmmidd + # Make sure you see the message that the drivers are signed by Amyuni Technologies Inc. This is a confirmation that the drivers went through Microsoft driver signing procedure and are virus free + deviceinstaller64 enableidd 1 +```