Line of Sight

This webpage is used to showcase/backup some of my coding projects and will get progressively cooler as I put time into it, but havent yet
Feel free to also check out http://www.awright2009.com
Email: resume@awright2009.com

Zoomy - September 2021

I thought to myself during this pandemic, I bet I could make Zoom. You know, the video conferencing app? So, why not. This, which I creatively dubbed "Zoomy", just supports two people, each side has a listening socket and connects to the other peer to peer style. Video is over TCP, audio is using another pair of sockets over UDP. The Voice Over IP (audio) is using the opus codec and OpenAL, which works really nice. I already had VoIP implemented in my graphics engine, so you would think adding it here would be quick and easy. I did too, but it wasn't. The video itself is captured using the old style "Video for Windows" API's, the resolution is 320x240 upscaled to 640x480. The capture actually uses YUYV format, so the data transfer is actually 320*240*2 bytes (150kb per frame), which isnt too bad. Since each side requires a listening socket you'll need to open things up in your firewall. One could make a server side app that just relays video, but too much trouble for something like this I think.

Real zoom uses H.264 and a similar resolution I hear. Using a video encoder is over kill for a simple app I think, but it could be added easily enough. But I probably sunk too much time into this already over the past few days. If I were to use a video encoder I wouldn't want anything GPU assisted, so software only. I would probably use ffmpeg's libavcodec, using H.264 or VP9 sound nice, but probably dont meet the real time requirement with a software encoder. Even JPEG or MPEG2 would be an improvement I think. Code is on my github here: http://github.com/akw0088/zoomy/

Using the same principals it shouldn't be too hard to make a remote desktop type app using the same bitmap streaming. So I was thinking afterward make a copy called roomy or something for remote desktop type remote control, maybe just add mouse support and force on screen keyboard usage if people really want to type things. Could also make the server side hidden making it sort of a payload or something to spook your friends. Or add key logging and all kinds of stuff that would probably get it marked as spyware or something

I had to borrow one stuffed animal because I didn't have two :p
(They are discussing how you measure the depth of the ocean using an apple)

zoomy video conference
Download zoomy.zip - Code and Binaries
Roomy - September 2021

So... about that roomy idea. This is the remote desktop app, it still needs work, but now supports the mouse and keyboard, but be careful as the screen updates slightly slowly. Started with just the idea of streaming webcam bitmaps being pretty similar to streaming desktop bitmaps. Getting a viewer working wasn't too bad with the initial code from zoomy. Once that worked decently I added the mouse support first, which was a bit of effort, but not the end of the world. I originally wasn't going to add the keyboard, but actually the keyboard was mind blowingly easy to add (just a keycode and a up/down state). Run the binary in server mode on the target machine with listen enabled, then on a different machine, mark server and listen off and set the ip to the comptuer running the server. It should then connect and start displaying the remote machines desktop. Be sure to allow the app through the windows firewall too, the server can run hidden, so kill it in task manager if you started it and it disappeared. You can setup the server to connect out and the client to listen if you'd like. Tested it over the net without compression and it works pretty good through my VPN. (Although I'm still amazed that I can VPN, wake on LAN my PC, remote desktop to it, do things, shut it down, disconnect VPN, all from my laptop from any location) Feel free to try it out, but not quite as nice as VNC or RDP (remote desktop) yet...

The screen shot is from running the client and server on the same machine, you get a hall of mirrors type effect, as it captures a screen shot of the window, who then displays it, then captures again etc. You'll see this same sort of thing with zoom desktop sharing too. But I thought it looked interesting. Second screenshot is of google, it's just the window screen shot, so the start menu you see is actually from the remote computer. (Which is true for the first screen shot too actually)

Oh yeah, github link here: http://github.com/akw0088/roomy/

roomy remote desktoproomy remote desktop
Download roomy.zip - Code and Binaries
EE Senior Design - Spring 2014

For my Electrical Engineering senior design project our subteam was tasked with transmitting digital data from a microcontroller to a remote location for analysis. The data being transmitted is filtered EKG (Heart Beat) data from a microcontroller connected via contactless sensors to a marathon runner. Cardiac arrest can occur when running long distances and the idea is to prevent this from occurring by monitoring for irregular heart beats.

Previous work used commercial off the shelf blue tooth communication chips, but were limited to short transmission distances. Our group (Mohammed Alsadah and Me) decided to perform Binary Frequency Shift Keying over FM using TTL level serial data from the microcontroller located on the runner's shirt. For FM reception we took advantage of the RTL2832U usb chip that can be used as a general software defined radio receiver. Note: This was a single semester project, for the first semester we did a EEG controlled (brain wave) robotic hand, but this one is cooler/more EE related imho.

WinFFT Image FM Transmitter
Download WinFFT reception code
YouTube: Reception Test
YouTube: Transmission Testing/Prototyping
CE Senior Design - Spring 2011
Garcia Bot at UNT

For my BSCE senior design project our team was tasked with determining the location of robots using the school's wifi network and to have the robots meet when given a command to do so. We were provided four acroname garcia robots which all contain a "gumstix" embedded computer on a chip that runs linux complete with a wifi expansion module for connectivity.

After reading various graduate thesis papers about wifi localization we decided to use what is known as the fingerprinting method. The idea is that you create a database of wireless signal strength readings at various reference points and compare the current location's signal to the database. The "closest" point in terms of signal distance is considered the correct location.

In order to accomplish this, we created various tools to view database information, visualize signal information, etc in addition to the code required for localization and meeting.

heatmap image heatmap image
heatmap image heatmap image
Heatmap images of the embedded system lab and common area between the EE and CS departments.


iwlist_plot screenshot
iwlist_plot application, written using C++ and the MFC api, demonstrating dijkstra shortest path algorithm and database information.
laser_plotembedded lab
Plot of multiple laser scans from the hoyuko URG-04LX ranger


One major obstacle was getting a development environment setup. The garcia robots contain ARM processors that require cross compilation. In order to help future students, we rebuilt the openembedded linux kernel and filesystem with gcc and loaded it onto a microsd card to allow for easy development. We were able to sucessfully locate the robots within 2-3 meters of their actual location and implemented a working meet command.

Download
iwlist_match-1.3.zip
iwlist_data.zip - iwlist_data.zip contains common area dataset three samples per point
scan_db.zip - scan_db.zip contains embedded lab dataset three samples per point
scan10.zip - scan10.zip contains embedded lab dataset ten samples per point
scholars_day.pdf - a paper written for UNT Scholar's Day event
altEngine2 - 2009
Cross platform 3d engine. (WinApi, Xlib, OpenGL, Direct3D, OpenAL) - YouTube - GitHub - Download - Doxygen

altEngine2 is the current version of my cross platform 3d engine that I work on whenever I have long periods of free time. It makes use of q3 formatted bsp maps.

Update: Changed quite a bit in 2018 or so, now supports OpenGL 4.4, D3D11, and software rendering. (perspective correct texture mapping, mipmapping with bilinear filtering) Added two more recent videos below, had some issue with nvidia shadow play recording properly in full screen, so left them windowed. Downloads page has dates / changelog if interested. (click OldVersions link)


Older Videos:
Major additions:
Real time lighting with normal mapping. Colored point lights exist as are defined by the quake3 map and are activated based on distance. I have stencil shading implemented for items, but shadow volume generation needs work for the map itself. See here for a video with dynamic lighting enabled
Mostly plane/point distance checks, have GJK implementation that works nicely for body/body collisions, but seperating axis theorem collision detection needs to be thrown in throughout
ODE Physics system. This is something I always wanted to program. Integrates netwon's equations of motion and handles collisions of multiple oriented bodies in real time. (ODE as in ordinary differential equation, just now noticed there is a physics engine middleware called ODE now)
The menu system doesnt use system dependent font rendering but instead renders all fonts as 2d full screen quads that are scaled and translated by a vertex shader and texture coordinates translated to the correct glyph by a pixel shader. Each menu page is encoded as a state with possible state transitions. Most menu systems that I've encountered were composed of very complex code where my code is extremely simple and data driven.
Client/Server networking model that streams sequenced UDP packets and implements reliable message passing based on acknowledged sequence numbers. Reliable message passing works well enough for chatting / syncing some gamestate (like the map), and entity streaming works well enough for movement / firing / gameplay, but can always use improvement.
I didnt want to implement it, but did so as the missing archways were the most identifiably ugly thing for a while. Took a long time to reverse engineer non 3x3 patch data. But I have code that handles most curves. Even the lions mouth on q3dm1 works now.
OpenGL 3.0 removes lots of outdated functionality. All transformations are done in vertex shaders and I am running in forward compatible mode. Updates in 2017/2018 move up to OpenGL 4.4
Direct3D11 could use some more attention since I havent used it in a while. (Dont worry linux still works) I also have a nice system that supports both opengl GLSL shaders and directx HLSL shaders and handles them the same. (This means you need to write the same shaders twice one for each api, but it's better than having to use some slowly updated middleware like CG.) I could probably get my engine working on the iphone if I tried. Updates in 2017/2018 add Direct3D11 support
Babel Compiler - Spring 2010
Shift/Reduce compiler that uses flex/bison.

Wrote this for a compilers course. It makes use of flex for parsing the input program into tokens and bison to perform the shift reduction of grammars. What did I do you ask? Well I made everything that flex/bison needed to work and wrote the code generation code. This was done in three weekends, the assembly generated is intel style assembly (AT&T style assembly can rot and die) The gnu assembler can assemble intel style x86 assembly easily with a few flags. So the final output can and does work on both windows and linux. The babel language was created by Professor Sweeny, it's basic language, but has all the requirements (loops, if statments, functions, recursion etc)

I really fought the idea of jumping to the end of a function to allocate temporary storage stack space and then jmping back, which is inefficient and therefore morally wrong for me to do as a programmer. (impossible to avoid this with single pass compilation) But I probably should of done it that way anyway as it gets complicated if you dont. I stored all temps on the stack. If anything this should serve as a quick example of how to use flex and bison. [Professor is a linux guy, so I used bzip2]

VHDL Projects - Spring 2010

These are projects from an EE digital logic project course. The code should all compile and work in Xilinx and run on a spartan 3e board, but I'm not sure if these are the latest versions we used as I pulled them out of old emails. Mainly have these here in case I want to use the spartan board I bought again.

Project1 is a basic ALU that has four instructions. Add/subtract, logical AND, logical OR.
Project2 is an alarm clock with stopwatch functionality. It works like a typical alarm clock with alarm, am/pm indicator, set buttons etc. The code includes a seven segment lcd decoder, Binary to BCD decoder, counters, clock dividers etc. Most everything is done at the gate level.
Project3 code isnt here, but it was a combination lock. Which is pretty much a finite state machine that accepts keypad input to transition to either an unlock or alarm state.
Project4 is a Reverse polish notation calculator. It has a stack to push operands and can perform addition, subtraction, multiplication, and XOR. This was the final project and I took advantage of process statements this time to make my life easy.
WebGrade ~ 2007
Course management system. (xhtml strict, css, javascript, php, ajax)

WebGrade is a university course management system which was a team project for a Fundamentals of Software Engineering course. I was the team leader of a group of three other students and also acted as lead developer. WebGrade allows an administrator or student to login to manage courses or view grades respectively. It is xhtml strict compliant and makes use of content / presentation division via cascading style sheets. Download it's source code below, username and password is root.

register page courses page report page
Download WebGrade - YouTube
altEngine ~ 2006 - 2004
Cross platform 3d engine. (WinApi, Xlib, OpenGL, OpenAL) - Download

altEngine is a first version of my engine. This one would be C instead of C++ and is pretty bare bones in comparison, but only copy I had laying about. I started using a local git repo in 2009 on a server before moving to github in 2012, and was just going without source control prior to that. It runs on windows and X windowing systems. (Runs fine on Linux and Mac OSX with X Window extensions installed.)

renderer pvs textured
clipMon ~ 2006
LCD Clipboard Monitor. (WinApi, lglcd sdk)

Clipmon is a LCD clipboard monitor for the Logitech G15 Keyboard. (still works on the newer G19 keyboard released 3 years later) It is written in C and makes use of the Windows API and low level logitech lcd sdk (Logitech later released a high level C++ API.) Source code is included with the binaries, I had to write my own word wrapping code because of difficulties using a higher level winapi text function and took a different (ie: weird) approach with exception handling. I wrote this thing in roughly 6 hours and like using it on occasion.

clipmonclipmon
Download clipMon
ircMon ~ 2006
LCD Internet Relay Chat Monitor. (WinApi, lglcd sdk, Winsock)

Like clipMon, ircMon is a Internet Relay Chat monitor for the Logitech G15 Keyboard. It is written in C and makes use of the Windows API, Winsock, and the same low level logitech lcd sdk. Source is not included as it isnt pretty and the irc protocol parser needs work. (IE: It will crash on you.) It worked well enough for me to lose interest in it. -- Added the source code, cause why not, I should fix it one day

Download ircMon
sealstats ~ 2003
Realtime Statistic Aggregator. (Perl, PHP, SQL)

Sealstats generates player rankings and stores statistical data from the Quake3 modification Navy Seals. Based on existing source code given to me by 'LostCause' who created the stats program for Urban Terror, another quake3 modification. I ported the code to work for navy seals and modified/extended existing functionality. A perl script parses the game log file in order to calculate statistics and inserts relevant data into a mysql database via the perl DBD module. PHP is then used to read from the database and display the statistical information. All of which happens in real-time as players play the game.

Upon asking for a logfile to help test the code, the developers of the mod took interest in the program and made it an official part of the navy seals modification. I delivered what I had and they took control of it from there. Images and html code were developed by democritis and other coding work was done by defcon-X.

main page main page with data player page top player page bottom
Note: empty database above left, wayback machine screenshot on right, but missing images. Check out the wayback machine link below for contents populated. Might photoshop them together eventually (running a game with that many players is a bit tough nowadays.)
Download sealstats - Wayback Machine
ns_dam ~ 2003
Quake 3 Map.

ns_dam is a map for the quake 3 modification navy seals that I made and never released. The files are too large to upload here, (now uploaded as of July 2016) but it is neat and shows some of my more artistic side. (or lack thereof) It has quake 3 team arena style terrain, terragen skybox, and just about every neat feature possible with q3map2 compiler. I did a quick compile of the map a looong time ago so the lighting isnt as perfect as it can be and the screenshots were taken quickly with texture settings set crappily. (mipmap nearest / picmip 1) Doing a good light compile can take days and odd lighting in places can make you have to restart the whole process. (While hoping the small changes you make to fix one thing doesnt break another.)

flag flag generators office stairway screenshot screenshot screenshot screenshot screenshot screenshot screenshot screenshot screenshot screenshot
Download ns_dam.pk3 (33mb)
(pk3 files are really zip files, .map files are included for editing. I think it has some other maps I made in there too if you fire up q3radiant/gtkradiant, but just load the map with /devmap ns_dam)
Note: It does need mapmedia.pk3 from qeradiant and some assets from the navy seals mod (eg: snowy pine tree)

q3f_military ~ 2001
Quake 3 Map.

This is that "other map" that I was referring to, went ahead and bsp'ed it and packed it up nicely, intended for the quake 3 team fortress mod, q3f, run it with /devmap q3f_military

screenshot screenshot screenshot screenshot Imagine the flag being there with electricity coming off those electrodes (if I downloaded the mod) screenshot screenshot screenshot screenshot screenshot screenshot
Download q3f_military.pk3 (17mb)
Papers ~ 2010


Quaternions often misspelled by myself as quanternions. These are a set of complex numbers generalized into three dimensions and can be used to smoothly rotate between two orientations. SLERP in action

        Good Reference videos for geometric interpretation:
                3Blue1Brown intro
                3Blue1Brown rotation
                3Blue1Brown interactive

                You can think of unit quaternions as a four dimensional sphere where each vector element is orthangonal and rotating in a loop.
                The fourth dimension distorts spheres into planes due to projecting down to 3d space.
                (Think of a point on a sphere with infinite radius, it is essentially a plane) and we have one sphere for each dimension. (real plane, x plane, y plane, z plane).
                At each of the cardinal directions (1,0,0,0) (0,1,0,0) (0,0,1,0) (0,0,0,1) we have 3 planes and a unit sphere.
                We limit ourselves to a unit quaternion to force our rotations to exist on a unit sphere in 3d. The fourth dimension extends to infinity in our 3d projection,
                but in reality it is just rotating in a dimension we cannot visualize.

Rigid Body Dynamics, think of it as simulating the physics of dropping your cell phone. This paper describes simulation of rigid bodies using newton's equations of motion and involves some scary math to make bodies rotate correctly in response to torque. Spring based and impulse based collision reponse methods are described. I also cover euler integration and fourth order runge kutta integration.
[I learned from Chris Hecker's tutorials, pixar's physically based modeling paper, and also a bit from Alan Watt's 3d computer graphics book]

-- I would suggest instead of using an impulse based approach as seen here, look into Extended position based dynamics XPBD, which acts on position instead of velocity and tends to be more stable. (although can feel like cheating at times) Another thing is the timestep, smaller is better, and sub-steps seem to be the way to go. But I do find taking larger steps when no collisions occur to be pretty critical with keeping things real-time, which we achieve with dividing the time step and re-running as seen here and with Chris Hecker's example.. Maybe start with regular Position Based dynamics here: Position Based Dynamics

Tangent Space. The final frontier. Tangent space is a coordinate system that best describes the face of a triangle. This paper describes how to find the normal, tangent, and bitangent vectors necessary to create a rotation matrix that will convert points and/or vectors from eye space to tangent space.