> Is there a way how to make the above code to work?

Clone your block before evaluating it. The following works for me:

    factorial := [:n | n <= 1
                         ifTrue: [1]
                         ifFalse: [n * (factorial clone value: n - 1)]
                 ].

    factorial clone value: 1