Posts

Showing posts from 2026

From Value Functions to Policy Search: How Modern AI Systems Learn to Act Under Uncertainty

Image
From Value Functions to Policy Search: Rethinking Decision-Making in Modern AI Systems In most traditional AI systems, decision-making is indirect. A model predicts an outcome, another layer interprets that prediction, and finally, a rule or heuristic decides what to do. This pipeline introduces complexity and latency. A different paradigm is emerging: What if systems could learn how to act directly—without first learning how to evaluate every possible state? This is the core idea behind policy search . The Shift: From Evaluating States to Learning Actions Classical decision-making follows a sequential dependency: State \(\rightarrow\) Value Function (\(V\)) \(\rightarrow\) Action (\(a\)) Policy search simplifies the runtime architecture by mapping observations directly to behavior: State \(\rightarrow\) Policy (\(\pi\)) \(\rightarrow\) Action (\(a\)) Instead of estimating value, we optimize a function that dictates b...

Quran Page 44: Faith, Resurrection, and the Multiplication of Sincere Charity

Image
📖 About Surah Al-Baqarah (Page 44) Page 44 continues with a powerful demonstration of faith and certainty through the story of Prophet Ibrahim (Abraham), who seeks reassurance about resurrection. It then transitions into profound parables about charity, illustrating how sincere spending in the way of Allah multiplies rewards, while insincere actions or reminders of charity nullify its value. The imagery used conveys spiritual growth, sincerity, and accountability. 🕌 Arabic Text (Page 44)   🌍 English Translation (Sahih International) Verse 260: And [mention] when Abraham said, "My Lord, show me how You give life to the dead." [Allah] said, "Have you not believed?" He said, "Yes, but [I ask] only that my heart may be satisfied." [Allah] said, "Take four birds and commit them to yourself. Then [after slaughtering them] put on each hill a portion of them; then call them - they will come [flying] to you in haste. A...

The $0 AI Agent That Runs My Investment Portfolio — What It Taught Me About Enterprise AI ROI

Image
Enterprise AI · Strategy The $0 AI Agent That Runs My Investment Portfolio — What It Taught Me About Enterprise AI ROI Technology Leadership ~900 words 5 min read I built an AI agent for $0 a month. Not as a side project. As a deliberate experiment to understand something every technology leader should understand before signing another seven-figure AI contract. It runs on a Raspberry Pi 5 sitting on my desk, powered by Home Assistant OS, connected to Telegram, and backed by a private GitHub repository. Every trading day at 2:30 PM it sends me a live portfolio snapshot — current value, capital P&L, dividend-adjusted total return, and which positions moved more than 3% with their technical signals. When I want signals on what to consider buying or selling, I type two words. The analysis comes back in under 90 seconds. I didn't build this because I couldn't afford a commercial alternative. I built it because I wa...

Quran Page 43: From Darkness to Light—Divine Sovereignty over Life and Death

Image
📖 About Surah Al-Baqarah (Page 43) Page 43 continues the profound message following Ayat al-Kursi, emphasizing the contrast between belief and disbelief. It highlights Allah as the protector of the believers, bringing them from darkness into light, while disbelief leads to the opposite. The page also presents powerful examples: the debate of Prophet Ibrahim (Abraham) with a king, and the story of a man witnessing resurrection after death—both reinforcing Allah’s absolute power over life and death. 🕌 Arabic Text (Page 43)   🌍 English Translation (Sahih International) Verse 257: Allah is the ally of those who believe. He brings them out from darknesses into the light. And those who disbelieve - their allies are Taghut. They take them out of the light into darknesses. Those are the companions of the Fire; they will abide eternally therein. Verse 258: Have you not considered the one who argued with Abraham about his Lord [merely] be...

How AI Systems Plan Under Uncertainty: From Lookahead to MCTS

Image
How AI Systems Plan Under Uncertainty: From Lookahead to MCTS In real-world AI systems, decisions are rarely made with complete information. Whether it’s an autonomous system navigating uncertain terrain, a fraud detection engine evaluating risk, or a robotics system reacting to sensor noise—decisions must be made before the future is known . Instead of asking “What will happen?”, these systems ask: “What should I do, given what might happen?” Mathematically, we aim to find the Optimal Action (\(a^*\)) that maximizes expected utility (\(U\)) over future states: \[ a^* = \arg \max_{a \in A} \sum_{s' \in S} T(s, a, s') [R(s, a, s') + \gamma V(s')] \] The Architecture of Choice: Navigating the Search Space As an AI Enterprise Architect, I view planning not just as an algorithm, but as a runtime architecture decision . The challenge is balancing the "Curse of Dimensionality" with the need for ...

Quran Page 42: The Majesty of Ayat al-Kursi and the Principle of No Compulsion (Surah Al-Baqarah 253-256)

Image
📖 About Surah Al-Baqarah (Page 42) Page 42 begins by acknowledging the different ranks of the Messengers and the role of divine will in human history. It then transitions into the monumental Ayat al-Kursi (The Throne Verse) , a comprehensive declaration of Allah's attributes. This page also features the famous declaration "La ikraha fid-deen" (There is no compulsion in religion), emphasizing that the path of righteousness is distinct and clear for those who choose to believe and hold onto the "trustworthy handhold" of faith. 🕌 Arabic Text (Page 42)   🌍 English Translation (Sahih International) Verse 253: Those messengers - some of them We caused to exceed others. Among them were those to whom Allah spoke, and He raised some of them in degree. And We gave Jesus, the Son of Mary, clear proofs and We supported him with the Pure Spirit. If Allah had willed, those [generations] after them would not have fought each other aft...

Quran Page 41: The Test of the River and the Victory of David (Surah Al-Baqarah 249-252)

Image
📖 About Surah Al-Baqarah (Page 41) Page 41 details the final trials of Saul's army. It begins with the test at the river , where the soldiers' discipline was measured by their restraint. Despite their small numbers, the believers' reliance on Allah led to the defeat of the formidable army of Goliath (Jalut) . This page famously introduces David (Dawud) , who slew Goliath and was subsequently granted kingship and wisdom by Allah. It concludes by affirming that these stories are true signs and revelations from Allah. 🕌 Arabic Text (Page 41)   🌍 English Translation (Sahih International) Verse 249: And when Saul went forth with the soldiers, he said, "Indeed, Allah will be testing you with a river. So whoever drinks from it is not of me, and whoever does not taste it is indeed of me, except one who takes [from it] in the hollow of his hand." But they drank from it, except a [very] few of them. Then when he had crossed it along...

The Agentic Architecture: How to Scale Velocity Without Sacrificing Reliability

Image
The Agentic Architecture: How to Scale Velocity Without Sacrificing Reliability In the transition from traditional coding to AI-augmented development, engineering velocity is no longer the primary constraint. With GitHub Copilot and agentic workflows, we can now manifest architecture into code at unprecedented speeds. The Core Thesis: As AI accelerates delivery, it also amplifies Architectural Drift . In an AI-first world, discipline isn't a hurdle—it’s the only scalable advantage. I. The Executive Perspective: Governance at Scale For leadership, moving to agentic AI means shifting from Manual Oversight to Automated Guardrails . When agents generate thousands of lines of code in seconds, human "eyes-on-code" becomes a bottleneck, not a safety net. Legacy Operating Model Agentic Operating Model Documentation is a lagging artifact Documentation is a required, generat...

Quran Page 40: Leadership, Divine Signs, and the Kingship of Saul (Surah Al-Baqarah 246-248)

Image
📖 About Surah Al-Baqarah (Page 40) Page 40 narrates the story of the Israelites after the time of Moses, where they requested a king to lead them in battle. It details the appointment of Saul (Talut) by Allah and the initial hesitation of the people based on worldly status. The page emphasizes that true leadership is a gift of knowledge and stature from Allah. It also mentions the return of the Ark of the Covenant (Tabut) as a miraculous sign of his rightful kingship. 🕌 Arabic Text (Page 40) 🌍 English Translation (Sahih International) Verse 246: Have you not considered the assembly of the Children of Israel after [the time of] Moses when they said to a prophet of theirs, "Send to us a king, and we will fight in the way of Allah"? He said, "Would you perhaps refrain from fighting if fighting was prescribed for you?" They said, "And why should we not fight in the way of Allah while we have been driven out from our h...

Quran Page 39: Guarding the Prayers and the Call to Sacrifice (Surah Al-Baqarah 238-245)

Image
📖 About Surah Al-Baqarah (Page 39) Page 39 emphasizes the central importance of Salah (Prayer) , specifically urging believers to maintain the middle prayer even in times of fear or travel. It then transitions to provide further rights for widows and divorced women, ensuring their fair treatment. The section concludes with a powerful spiritual call to sacrifice in the way of Allah, presenting the concept of Qardan Hasana (a goodly loan) and illustrating the consequences of those who hesitate when called to strive for their faith. 🕌 Arabic Text (Page 39) 🌍 English Translation (Sahih International) Verse 238: Maintain with care the [obligatory] prayers and [in particular] the middle prayer and stand before Allah, devoutly obedient. Verse 239: And if you fear [an enemy, then pray] on foot or riding. But when you are secure, then remember Allah [in prayer], as He has taught you that which you did not [previously] know. Ve...

From Bayesian Networks to Enterprise Decision Systems: How AI Handles Uncertainty in the Real World

Image
From Bayesian Networks to Enterprise Decision Systems: How AI Handles Uncertainty in the Real World In most real-world systems, decisions are rarely made with certainty. 🛡️ A cybersecurity platform flags a potential intrusion. 🚁 An autonomous drone detects a signal anomaly. 💳 A fraud detection system evaluates a suspicious transaction. In all these cases, the system is not asking: “Is this true?” It is asking: “Given what I observe, how likely is this to be true?” That question sits at the heart of probabilistic inference — and more specifically, Bayesian Networks . The Hidden Engine Behind Intelligent Systems Modern AI systems don’t just classify or predict. They reason under uncertainty . At the core of this reasoning is a simple idea: P(Hypothesis | Evidence) For example: What is the probability of a cyber attack given unu...

The Post-Elderlings Dilemma: Mapping My Next Literary Odyssey

Image
The Post-Elderlings Dilemma: Mapping My Next Odyssey A curated look at the contenders for my next two-year journey. Closing the final page of a Robin Hobb masterpiece leaves a specific kind of silence. It is a quiet, heavy space where you aren't quite ready to leave the characters you've lived with for years, yet you feel the itch for a new horizon. I reached out to fellow travelers, and the response was overwhelming. My desk is now buried under a mountain of maps and legends. Before I reveal the chosen one, I wanted to share the "Archives of Consideration"—the books that are currently whispering to me from the shelf. The Archives of Consideration The Epic Heavyweights The Stormlight Archive / Cosmere (Brandon Sanderson): Often called the modern king of worldbuilding. What makes this special is the "Hard Magic"—systems with strict rules that feel like a science. It’s grand, vast, and deeply focused on broken people finding ...

Quran Page 38: Ethics of Bereavement and Marital Financial Rights (Surah Al-Baqarah 234-237)

Image
📖 About Surah Al-Baqarah (Page 38) Page 38 provides compassionate legislation for sensitive family transitions. It establishes the waiting period (Iddah) of four months and ten days for widows, ensuring they are protected and their status is clear. The page also offers guidance on the etiquette of marriage proposals during this period, emphasizing sincerity and the avoidance of secret contracts. Finally, it details the financial rights of women in cases of divorce occurring before the marriage is consummated, highlighting the importance of generosity and fairness. 🕌 Arabic Text (Page 38)   🌍 English Translation (Sahih International) Verse 234: And those who are taken in death among you and leave wives - they [the wives] shall wait, keeping themselves [alone], for four months and ten [days]. And when they have fulfilled their term, then there is no blame upon you for what they do with themselves in an acceptable manner. And Allah is [fully...