-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
127 changed files
with
163 additions
and
127 deletions.
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
<!doctype html><html lang=en-us><head><meta charset=UTF-8><meta name=viewport content="width=device-width,initial-scale=1"><meta http-equiv=X-UA-Compatible content="IE=edge"><link rel=preconnect href=https://fonts.googleapis.com><link rel=preconnect href=https://fonts.gstatic.com crossorigin><link href="https://fonts.googleapis.com/css2?family=Commissioner:wght@100;300;400;500;700&family=IBM+Plex+Sans:ital,wght@0,100;0,300;0,400;0,500;0,700;1,300;1,400;1,500;1,700&display=swap" rel=stylesheet><link rel=stylesheet href=https://cdnjs.cloudflare.com/ajax/libs/font-awesome/6.1.1/css/all.min.css integrity="sha512-KfkfwYDsLkIlwQp6LFnl8zNdLGxu9YAA1QvwINks4PhcElQSvqcyVLLD9aMhXd13uQjoXtEKNosOWaZqXgel0g==" crossorigin=anonymous referrerpolicy=no-referrer><script src=https://code.jquery.com/jquery-3.6.0.min.js integrity="sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=" crossorigin=anonymous></script><link rel=preconnect href=https://fonts.googleapis.com><link rel=preconnect href=https://fonts.gstatic.com crossorigin><link href="https://fonts.googleapis.com/css2?family=Jost:ital,wght@0,100;0,300;0,400;0,500;0,700;1,300;1,400;1,500;1,700&display=swap" rel=stylesheet><script src="https://polyfill.io/v3/polyfill.min.js?features=es6"></script><script id=MathJax-script async src=https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-mml-chtml.js></script><script>window.MathJax={loader:{load:["[tex]/physics"]},tex:{packages:{"[+]":["physics"]}}}</script><title>CALP</title> | ||
<meta name=description content="Contraindicated offline POMDP solver. | ||
Contrained belief state MDP Linear Programming belief set generation Approximate POMDP with Contrainst CPOMDPs are Hard Can’t do DP with pruning: optimal policies may be stochastic Minimax quadratically contained program: computational intractable Contained PBVI struggles with contraint satisfaction CALP Core Idea Recast CPOMDP as a contrained belief-state MDP. | ||
We replace our state-space with our belief space: | ||
\(S = B\) \(s_0 = b_0\) You essentially assume here that there is some finite belief space."><meta name=author content="Houjun Liu"><link rel=stylesheet href=/css/global.css><link rel=stylesheet href=/css/syntax.css></head><body><div class=center-clearfix><header><span id=header-name onclick='window.location.href="/"' style=cursor:pointer>Houjun Liu</span><div id=socialpanel><a href=https://www.jemoka.com/search/ class=header-social id=header-search><i class="ic fa-solid fa-magnifying-glass"></i></i></a> | ||
<a href=https://github.com/Jemoka/ class=header-social id=header-github><i class="ic fa-brands fa-github"></i></a> | ||
<a href=https://maly.io/@jemoka class=header-social id=header-twitter><i class="ic fa-brands fa-mastodon"></i></a> | ||
<a href=https://www.reddit.com/user/Jemoka/ class=header-social id=header-reddit><i class="ic fa-brands fa-reddit"></i></a></div></header><div id=title><h1>CALP</h1><span class=tagbox></span></div><aside id=toc><h1 id=toc-title>table of contents</h1><nav id=TableOfContents><ul><li><a href=#cpomdps-are-hard>CPOMDPs are Hard</a></li><li><a href=#calp-core-idea>CALP Core Idea</a></li></ul></nav></aside><main><article><div><p><strong>Contraindicated</strong> offline POMDP solver.</p><ul><li>Contrained belief state MDP</li><li>Linear Programming</li><li>belief set generation</li><li>Approximate POMDP with Contrainst</li></ul><h2 id=cpomdps-are-hard>CPOMDPs are Hard</h2><ul><li>Can’t do DP with pruning: optimal policies may be stochastic</li><li>Minimax quadratically contained program: computational intractable</li><li>Contained <a href=/posts/kbhpoint_based_value_iteration/>PBVI</a> struggles with contraint satisfaction</li></ul><h2 id=calp-core-idea>CALP Core Idea</h2><p>Recast <a href=/posts/kbhcpomdp/>CPOMDP</a> as a contrained <a href=/posts/kbhbelief_state_mdp/>belief-state MDP</a>.</p><p>We replace our state-space with our belief space:</p><ul><li>\(S = B\)</li><li>\(s_0 = b_0\)</li></ul><p>You essentially assume here that there is some finite belief space.</p></div></article></main><footer><p id=footer>© 2019-2024 Houjun Liu. Licensed CC BY-NC-SA 4.0.</p></footer></div></body></html> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.