Cel's (Colby's) CompSci Project Blog

Date: 2016-01-15

So Long!

Box figure 34

Box figure 36

We're now at the end of the semester, and I've been given a choice: continue with this project for another semester, or try something else?

I've decided to switch to a different project. Why? This project has been very interesting, but I haven't been learning as much as I could have. I'm going to focus on something that will, in and of itself, teach me something.

Still, I've wrapped up my work on this project, and it's a usable version! See the link at the end of this post for the downloadable version.

I'll be posting a link to my blog for the next project shortly.

Cheers, Colby Skeggs.

The current version of my code is v0.2.0: cd6b807311b9f373f80e418f186d74e572d890a9.

Comments
Date: 2016-01-11

Better highlighting! (minipost)

More usability! Now it's clear which figure is currently selected.

Box figure 36

(Look at the handles. The selected figure, at the left, has a different color.)

Cheers, Colby Skeggs.

Comments
Date: 2016-01-11

Better controls! (minipost)

It's a bit more usable! The buttons now have readable labels.

Box figure 35

Cheers, Colby Skeggs.

Comments
Date: 2016-01-06

Line variance

With a bit of work, I went from this:

Box figure 32

to this:

Box figure 34

There, smoothing is better and some of the weird visual artifacts are gone!

Cheers, Colby Skeggs.

Comments
Date: 2016-01-06

Back to work!

Now that school is back in session, it's now time to get back to work!

Comments
Date: 2015-12-16

Line variance

With a bit of work on posing, the feet started to look a bit better:

Box figure 31

But I've digressed slightly to take care of line widths: note how that third small character has overly thick lines, since they aren't varied with scale.

To fix this, I changed the pen styles to be dynamically generated based on both scale and style, not just style:

Box figure 32

Another example:

Box figure 33

The line width variance helped, but it probably needs to have a smarter nonlinear system.

(The feet still need some more work too.)

Cheers, Colby Skeggs.

Comments
Date: 2015-12-07

Bloopers (minipost)

Box figure 23 Box figure 24 Box figure 25 Box figure 26 Box figure 27 Box figure 28 Box figure 29 Box figure 30

This doesn't look right yet. But I'm iterating!

Comments
Date: 2015-11-25

Spline Legs! (Minipost)

Box figure 22

This change actually involved removing code, rather than adding it! (Because now it can share the same code as the arms.)

However, I'm not completely sure that I like it better like this.

I might revisit this decision later.

Cheers, Colby Skeggs.

Comments
Date: 2015-11-25

Bezier Curves!

Box figure 21Box figure 20

At the left: the new arm drawing system. At the right: the old arm drawing system.

Why did I change this? The old version was naively using Racket's builtin spline drawing tool, which is given two endpoints and a control point. Unfortunately, the curve doesn't actually go through the control point. And it uses line segments on the ends. Bleh.

Now, it turns out that it's not easy to figure out how to draw a curve through a given point. Luckily, I found Rob Spencer's bezier curve fitting algorithm, which does exactly what I want!

I implemented this:

(: calc-control-points (-> Vector2D Vector2D Vector2D Float (Values Vector2D Vector2D)))
(define (calc-control-points v0 v1 v2 t)
  (let ((d01 (vdist v0 v1))
        (d12 (vdist v1 v2))
        (r20 (v- v2 v0)))
    (let ((fa (/ (* t d01) (+ d01 d12)))
          (fb (/ (* t d12) (+ d01 d12))))
      (values (v- v1 (v*c r20 fa))
              (v+ v1 (v*c r20 fb))))))

After I did this, it still didn't work... as it turned out, you actually need to cut up the curve into two separate quadratic bezier curves, not one single cubic bezier curve!

Unfortunately, Racket doesn't have any methods for drawing quadratic bezier curves... but I searched around and found a post on the cairo mailing list (cairo is the vector graphics library that Racket uses as a backend for drawing) that explains how to convert.

Now I can implement that too:

(: quadratic->cubic (-> Vector2D Vector2D Vector2D (Values Vector2D Vector2D Vector2D Vector2D)))
(define (quadratic->cubic p0 p1 p2)
  (values p0
          (vinterpolate p0 p1 (/ 2.0 3.0))
          (vinterpolate p1 p2 (/ 2.0 3.0))
          p2))

So, then, with that, I can use the control points and the endpoints to find two cubic curves:

(: fit-cubics (-> Vector2D Vector2D Vector2D Float (Values Vector2D Vector2D Vector2D Vector2D    ; cubic 1
                                                           Vector2D Vector2D Vector2D Vector2D))) ; cubic 2
(define (fit-cubics v0 v1 v2 t)
  (let-values (((cp1 cp2) (calc-control-points v0 v1 v2 t)))
    (let-values (((ca0 ca1 ca2 ca3) (quadratic->cubic v0 cp1 v1))
                 ((cb0 cb1 cb2 cb3) (quadratic->cubic v1 cp2 v2)))
      (values ca0 ca1 ca2 ca3 cb0 cb1 cb2 cb3))))

And finally, it all worked!

Cheers, Colby Skeggs.

The current version of my code is v0.1.6: 95619bad551f93d084e43fd25e9cc5fbb50387e8.

Comments
Date: 2015-11-25

Splines! (Minipost)

Box figure 20

These actually weren't that hard! However, I'm not completely satisfied with these - the lengths of the splines aren't preserved properly. Just look at those arms.

(Behind the scenes, I also abstracted out the limb handling code so that I didn't duplicate it across right-arm vs left-arm, which will come in handy once I start using it for legs too.)

I might want to try writing my own spline-handling code, but I'm not sure if that would be efficient enough compared to what's probably GPU-rendered splines.

Cheers, Colby Skeggs.

Comments
Date: 2015-11-23

More faces! (Minipost)

Box figure 18Box figure 19

I also fixed a bug causing the face to disappear in rare occasions, and a bug preventing me from saving any patterns with an 'n' in a setting name.

The ability to switch between faces also required some more rendering infrastructure.

Also, I figured out that running my program from the shell is slightly faster to typecheck than running it from DrRacket.

Comments
Date: 2015-11-23

Face rotation! (Minipost)

The only previous option for face direction:

Box figure 14

Some of the unlimited number of new options:

Box figure 15

Box figure 16

Box figure 17

Comments
Date: 2015-11-23

Wrapped Drawing

Hi!

Remember the issues with expensive contracts?

The worst part was this:

(Instance DC<%>)

To solve the problem (mostly), I extracted a separate untyped file that would wrap all of the drawing operations, so that none of the expensive interfaces would be typechecked.

I correspondingly wrapped everything in opaque types:

(require/typed "wrap-draw.rkt"
               [#:opaque ColorInst wd:color?]
               [#:opaque PenInst wd:pen?]
               [#:opaque BrushInst wd:brush?]
               [#:opaque Context wd:context?]

I tested the relative timing by thunking out the main code (wrapping it in a thunk call), which would run everything except actually running the program.

Original:

real    0m34.283s
user    0m33.503s
sys 0m0.847s

Modified:

real    0m19.052s
user    0m18.343s
sys 0m0.747s

Hooray! That's nearly half the typechecking time chopped off.

Cheers, Colby Skeggs.

Comments
Date: 2015-11-19

Comments

A quick note - I've added a commenting system to this blog! It may undergo further evolution, but it works.

You can log in with a Google account and then post away.

Cheers, Colby Skeggs.

Comments
Date: 2015-11-05

We are shocked!

Box figure 12

Good evening!

My figures have now developed faces!

Unfortunately, they've yet to develop emotions, so they all just look shocked thanks to fix mouth shapes.

How much work did this take to implement?

The hardest part was probably figuring out the math behind translating along a sphere:

(: x*c (-> Vector2D Float Vector2D))
(define (x*c v s)
  (vec (* (vec-x v) s) (vec-y v)))

(: translate-along-sphere (-> Vector2D Vector2D Vector2D Float Vector2D))
(define (translate-along-sphere center top align tx)
  (let* ((rel-top (v- top center))
         (rel-align (v- align center))
         (radius (vlen rel-top))
         ; such that (= (vrotate-rad rel-top rotation-to) (vec 0 radius))
         (rotation-to (atan (vec-x rel-top) (vec-y rel-top)))
         (rot-align (vrotate-origin-rad rel-align rotation-to))
         (x-for-the-y (sqrt (- (sq radius) (sq (vec-y rot-align)))))
         (scale-factor (/ x-for-the-y (vec-x rot-align)))
         (inv-scale-factor (/ 1 scale-factor))
         (scalerot-align (x*c rot-align scale-factor))
         ; (/ tx radius) is the translation of length tx around a circle of length radius, in radians!
         (translation (- (/ tx radius)))
         (scalerot-tx (vrotate-origin-rad scalerot-align translation))
         (rel-tx (vrotate-origin-rad (x*c scalerot-tx inv-scale-factor) (- rotation-to)))
         (final-tx (v+ rel-tx center)))
    final-tx))

(This is approximate; I had to do a couple of other things to get it to typecheck.)

Essentially, this algorithm recenters and rotates the head, and then scales the target point out to the border, and moves it a fixed amount around the border based on radius and expected distance, and then reverses all of those transformations.

After I had that working, I needed a few more rendering styles:

(define eye-style (r:wrap-style "black" 1 'solid "black" 'solid))
(define nose-style (r:wrap-style "gray" 1 'solid "gray" 'solid))
(define mouth-style (r:wrap-style "black" 2 'solid "white" 'solid))

A handle for the face (the only part manipulatable right now, which controls the face's position):

(define face (attach-joint-rel! jts 20.0 0.0 head))

Which needs to be kept within the head area:

(attach-limited-bone! skel face head 0.6)

Three corners of the head circle:

(define top-of-head (dynamic-joint scale () () (head)
                                   (v- head (vec 0.0 (scale* scale 0.7)))))
(define right-of-head (dynamic-joint scale () () (head)
                                   (v+ head (vec (scale* scale 0.7) 0.0))))
(define left-of-head (dynamic-joint scale () () (head)
                                   (v- head (vec (scale* scale 0.7) 0.0))))

And some virtual joints for the positions of the mouth, nose, and eyes via rotation around the sphere on axes defined by the head's corners:

(define nose (dynamic-joint scale () () (face head top-of-head)
                            (translate-along-sphere head top-of-head face (scale* scale 0.2))))
(define mouth (dynamic-joint scale () () (face head top-of-head)
                            (translate-along-sphere head top-of-head face (scale* scale 0.4))))
(define left-eye (dynamic-joint scale () () (face head top-of-head right-of-head)
                                (translate-along-sphere head right-of-head face (scale* scale 0.2))))
(define right-eye (dynamic-joint scale () () (face head top-of-head left-of-head)
                                 (translate-along-sphere head left-of-head face (scale* scale 0.2))))

And finally some circles for the actual rendering:

(attach-circle! pat left-eye 0.07 eye-style)
(attach-circle! pat right-eye 0.07 eye-style)
(attach-circle! pat nose 0.03 nose-style)
(attach-circle! pat mouth 0.1 mouth-style)

This actually doesn't seem like all that much - that's the advantage of spending so long on infrastructure!

Here's the editor view of that scene:

Box figure 13

(Which, by the way, I loaded from a savefile saved when I made the original image. And it came back exactly the same!)

Cheers, Colby Skeggs.

The current version of my code is v0.1.5: ad10fe891548dae3a89561743ae1590c747b4b1a.

Comments
Date: 2015-11-05

Contract generation

Hello again.

After a bunch of time chatting with people familiar with Typed Racket, including its developers on IRC, I determined one of the main causes of my slowdown.

(define-type Renderer (Pairof (-> (Instance DC<%>) Void) (-> Float Float Boolean)))

The worst part is this:

(Instance DC<%>)

Essentially, this is a type specifier for instances conforming to an interface. Said interface, DC<%>, is BIG. The generated contracts have to cover the entire interface to check that objects are properly behaved!

This is, of course, very annoying, as I don't actually NEED most of the contracts! They're primarily used for interactions between typed and untyped code, which isn't a thing I'm doing.

The worst part is that there is no easy fix.

Possibilities:

I may choose the last one, but I'm going to do a bit more work on other things first.

Cheers, Colby Skeggs.

Comments
Date: 2015-11-05

Optimizations 2: Electric Boogaloo! (minipost)

Hello again!

I solved the optimization problem with a single solution!

(require racket/async-channel)

(provide dropping-worker)

(define (process-channel func channel)
  (let loop ((value (async-channel-get channel)))
    (let ((v2 (async-channel-try-get channel)))
      (when v2
        (loop v2)))
    (func value)
    (process-channel func channel)))

(define (dropping-worker func)
  (define channel (make-async-channel))
  (thread
   (lambda () (process-channel func channel)))
  (lambda (work)
    (async-channel-put channel work)))

How does this snippet of code help?

It provides a useful abstraction for running operations in another thread: you call the function returned by (dropping-worker f) on a parameter, which runs f on that parameter in another thread! Easy!

... but how does that help? Well, we actually do a second thing, in process-channel: we grab an item to run off of the message channel... and then, as long as there's something else available on the channel, we discard our current value and take the next one. This means that, essentially, we collapse everything remaining down into just one item to process. In our case, that works, because rendering twice should, in theory, give us the same result both times.

This now means that we don't have a huge number of rendering events to process - at any point in time, we just need to finish the current render and do one more in order to be up-to-date. This gets rid of the lag issue with trying to move around anything a significant amount.

What's the trade-off? Well, now we do have jitter, but it's minimal at low usage counts, and even with around 21 characters on the screen, it's still mostly usable:

Box figure 11

At this point, the lag problem is solved. I still have the typed racket typechecking lag to think about - it takes about 35 seconds to typecheck my program! Since it does that every single time, iteration is very hard. I could be much more productive if this didn't take so long, so I plan to spend a bit of time trying to fix it.

Cheers, Colby Skeggs.

Comments
Date: 2015-11-03

Optimizations! (minipost)

Hello!

Latest work: after a bunch of optimizations, involving a bunch of type specifying and other things according to the optimization helper, the lag in the viewer is much improved!

Specifically, the system now doesn't slow down at all, until the seventh figure, whereas the earlier version slowed significantly down at the third figure.

The old version became annoyingly slow here:

Box figure 9

The new version got up to eight figures before being annoyingly slow:

Box figure 10

I do plan to make this even better shortly, before I move on. Also, I may take a divergence to see if I can optimize Typed Racket's typechecking at all.

Cheers, Colby Skeggs.

Comments
Date: 2015-10-22

diff (minipost)

Just to show that I was actually working, here's the diffstat output for that last version:

editor.rkt               |  12 +----------
entity.rkt               |  29 ++-----------------------
functional-graphics.rkt  |  10 ++++++++-
geometry.rkt             |  60 ++++++++++++++++++++++++++++++++++++++++++++++++++++
gui-controls.rkt         |   7 ++++---
joints.rkt               | 147 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
main.rkt                 |   3 ++-
pattern-base.rkt         |  94 ++++++++++++++++++++++++++++++++++++++++++++++++------------
---------------------
pattern-box-figure.rkt   |  90 ++++++++++++++++++++++++++++++++++++++----------------------
------------------
pattern-stick-figure.rkt |  44 +++++++++++++++++---------------------
saving.rkt               |   5 +++--
setting-group.rkt        | 115 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
+++++++++++++++++++++++++++++++++++++++
setting.rkt              |  87 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
+++++++++++++++
skeleton.rkt             | 190 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++-
-------------------------------------------------------------------------------------------
-------------
utils.rkt                |  68 +++++++++++++++++++++++++++++++++++++++++++++--------------
vector.rkt               |   6 +++++-
16 files changed, 674 insertions(+), 293 deletions(-)
Comments
Date: 2015-10-22

Settings!

Hello again!

I've been very busy with everything else this past month, so my work on this project has been mostly limited to class time.

Unfortunately, that means that something that should have been faster took quite a while.

So what did I do? Settings!

Specifically, all entities have saveable-and-loadable settings, arbitrarily definable. This required lots of work on Setting Groups, Setting Prototype Groups, Settings, and Setting Prototypes, in addition to reworking of the scale setting to use the same system.

Currently, there are a few too many places where I snuck around typing issues with a cast, but it all seems to work. Also, both compilation and running the program are starting to get pretty slow... the part of building the program being slow is a known Typed Racket issue, and the part with the probably is probably an inefficiency in my code.

Now, what did I do with settings?

Box figure 7

I added a geometry module, which lets me do things like automatically choose the elbow's position based on hand position. However, there are two options for the elbow position for a specific hand position, so I needed options, which mean I needed the entire setting infrastructure, and that's why this feature took a month.

Behind the scenes, none of the elbow positions for these figures are specified:

Box figure 8

Each one has options for whether the elbow is going up or down. This system, despite requiring a lot more code, is very useful from a usability standpoint.

(One other reason this took so long is that it also required extending the saving-and-loading system to handle settings, setting prototypes, setting groups, and setting prototype groups.)

Where do I go next with this? Well, unfortunately, the long compile times and the lag in the viewer are a big enough problem that I'm going to have to tackle them before going further. There's no sense in working with tools that slow you down.

Cheers, Colby Skeggs.

The current version of my code is v0.1.4: 6416dae2250235017dfe29666e1a2beb3804af57.

Comments
Date: 2015-10-01

Colors and Polygons! (minipost)

Box figure 6

(: attach-poly! (->* (PatternDef (Listof JointRef)) (Style) Void))
(define (attach-poly! pat joints [style r:all])
  (attach-renderer! pat (lambda ([vecs : (Listof Vector2D)] [scale : Scale])
                          (style (r:poly (for/list ((joint joints))
                                           (joint-v-ref scale vecs joint)))))))
Comments
Date: 2015-09-29

Bloopers I (minipost)

I made some mistakes with a different model...

Box figure 9

Box figure 10

Box figure 11

Box figure 12

And then finally got something slightly better:

Box figure 13

This is supposed to vaguely mimic the original art style of the OOTS comics. These are a lot simpler than some of what I plan to get to, but require more advanced techniques than the stick figures.

Cheers, Colby Skeggs.

The current version of my code is v0.1.3: 339c3c63effe0429d00eff08a8f0644e5d93fa0b.

Comments
Date: 2015-09-28

Improved Engine!

Hello again!

Recently, I restructured everything in my codebase. This was because it wasn't designed well and was getting unwieldy. Now that's fixed!

As part of the restructuring, I added better support for multiple figures (namely, deleting them), added support for settings on each of these figures, and added the ability to save and load projects!

Stick figure 7

The current best example of a setting is the scale factor, as demonstrated in the above image.

The save files look something like this:

((stick-figure-basic
  ((#s(par-vec 248.35514557749573 228.90217394558664)
    #s(par-vec 251 262)
    #s(par-vec 251.57608258650384 309.4298349139509)
    #s(par-vec 232.52938044236288 276.876709681069)
    #s(par-vec 218.08089278361678 258.06922494352796)
    #s(par-vec 239.18650979546277 282.56506083057087)
    #s(par-vec 220.16354247181653 268.4014810577428)
    #s(par-vec 246.0915057349493 337.3563638203401)
    #s(par-vec 248.83407109419204 365.6839111065116)
    #s(par-vec 251.45769568048397 337.8895886820439)
    #s(par-vec 254.1542010763213 366.22155752732925))
   1423/30)))

They're saved with Racket's reading/writing capabilities, with a bit of processing on top to handle vectors.

One of the downsides to the current setup is that the descriptions for patterns are noticably longer... but that's because I realized that the brevity wasn't going to be helpful once I moved beyond stick figures.

The current interface looks something like this:

Stick figure 8

So, anyway, this means that I've completed three of the four next steps from two posts ago!

I haven't done Perspective yet, because I'm not 100% sure that it will be immediately helpful, and I don't want to have to rewrite a bunch of stuff again right now.

The good news: now I can do something more relevant to my actual project!

(I'll post again soon with more details.)

Cheers, Colby Skeggs.

The current version of my code is v0.1.2: 6e13fbda269fe8911b6294736ec19e66fa9585b3.

Comments
Date: 2015-09-18

Multiple Figures! (minipost)

Stick figure 5

Stick figure 6

Cheers, Colby Skeggs.

Comments
Date: 2015-09-13

What's next? (an addendum to 'Typed Racket!')

Some of my next steps include:

Cheers, Colby Skeggs.

Comments
Date: 2015-09-13

Typed Racket!

Hello again!

Recent updates on my progress:

Let's see where this goes.

Cheers, Colby Skeggs.

The current version of my code is v0.1.1: d1fb88b65e6c5376a3ff19d7343f7f8a59d29e01.

Comments
Date: 2015-09-04

Project Plan!

Hello!

This blog is about Scribbles (final name pending), a computer science project about computer art.

Not art as in fractals or anything, but rather art as in illustration art as would be drawn by a human using a computer.

Here's an example of what I mean (a stick figure drawn by my current early prototype):

Stick figure

And with the handles visible:

Stick figure 2

As an example, take a look at this speedpaint from an artist. That should make the (very approximate) art style clear; and examples like that of how humans can draw will be very useful - to draw like a human, one should probably use techniques used by humans.

This is an extremely difficult idea! I find it likely that I may fail, but I do understand that. In any case, it'll be an interesting learning experience!

Let's see where this goes.

Cheers, Colby Skeggs.

The current version of my code is v0.1.0: c092f74d801a1f65e98ea1d6e5823343bf561a3b.

Comments