Squeak-dev

squeak-dev@lists.squeakfoundation.org

1 participants
79885 discussions

Squeak Robot
by Jon Hylands 27 Apr '24

27 Apr '24

So, here's a short little video, showing my quad walker robot on a stand (which is running Squeak on a Raspberry pi zero 2 w), being controlled by a sort-of smart watch I designed and built. I call that device a URC, which stands for Universal Robot Configurer, and it allows you to control and configure a robot using a peer-to-peer networking technology called ESPNow. The code on the URC is written in MicroPython (running on an ESP32), but as I said before, the robot is running Squeak. - Jon https://www.youtube.com/watch?v=UhJfxAyPefs

1 0

the deferred action queue prevents GC of closed windows
by Eliot Miranda 26 Apr '24

26 Apr '24

Hi All, I'm simulating a VMMaker image generated by closing several windows, leaving only a single workspace open: Monticello Browser Transcript In-image Compilation Workspace Message Names Form CameraInterface class Form In-image Compilation Workspace IGC Workspace Webcam Workspace 3DICL Source Generation Workspace Recording Workspace Spur and 3D Synchronization Workspace (play A) ToDo Workspace Socket Workspace WebCam Resolution Workspace Slang Test Workspace Message Names VM Simulation Workspace Version: 3DICC-Plugins-eem.115 Senders of buildCenterRows Slang Test Workspace Workspace Alas all the closed windows are still present, and still consuming lots of time getting processed at start-up time. The thing keeping all these instances alive is the DeferredActionQueue class var of ControlManager. I think this should be a weak dictionary. Alternatively, any time a window is closed it should be purged from this queue. _,,,^..^,,,_ best, Eliot

1 1

SqueakSource, Seaside, and web bot meltdowns
by lewis＠mail.msen.com 26 Apr '24

26 Apr '24

Below is a copy of a recent discussion on the box-admins Slack channel. I am copying it here to the mailing list so the discussion will not be lost. Some of this is administrivia but it includes Levente's explanation of why this is a problem on our SeasSide/SqueakSource services, and what can be done to improve the situation. In addition to blocking the bot traffic, it also may be possible (details below) to make Seaside much less vulnerable to this activity. Dave === thread from slack chat below === lewis 4 days ago I see some evidence that squeaksource.com running on dan.box.squeak.org is being hit by a bot of some sort. I can see activity in the Squeak process browser (VNC connection), and I also see activity in /proc/<squeakpid>/fd/ that looks like it may be someone scanning projects through the squeaksource.com service. This may be the source of the high system load and sluggish response that we have been seeing, and it does some to be getting worse over time. Is there any kind of log or utility that I can use to get an idea of where these connections are coming from? These would be connections routed through alan to connect to dan. Thanks for any tips or suggestions. 22 replies leves 3 days ago I think I have mentioned it a couple times that ~99% of all traffic is bot traffic. The way seaside handles urls is very different than how the rest of the web does, and that confuses bots. They think that the urls they get with the session id and page key can be visited later, but when they do, they'll just create a new session with many new links to visit. Seaside's session management is quadratic: creating/accessing/deleting a session requires as many operations as sessions exist. A long time ago, I created an alternative session registry for Seaside 2.8, that requires amortized constant time to create/access/delete a session. http://leves.web.elte.hu/linkeddictionary/ . But the seaside team decided to go down a different path about session management. It became pluggable, so my version couldn't be used since Seaside 2.9. Anyway, we can filter out some of the bot traffic to reduce the load if there's need. leves 3 days ago And to answer your question, yes, there are logs on alan. /var/log/nginx/squeaksourcecom-access.log has the current day's log (according to UTC) and /var/log/nginx/squeaksourcecom-access.log.1 has the previous day's log. The latter file currently has 2.6 million entries, so there were that many requests. leves 3 days ago Just noticed that you don't have a user on alan yet. I can either create a user for you, or I can copy some of the files over to dan. lewis 3 days ago Thanks Levente. I would appreciate if you can give me an account on alan. I will use it with care, and it will help me to figure out problems like this. Thank you, and thank you for the explanation of the Seaside issues. lewis 3 days ago And yes, if there is a way to filter out some of the bot traffic, I think we are at a point where it is becoming necessary. I am mainly watching dan.box.squeak.org but I expect that the same issues apply to our source.squeak.org server on andreas.box.squeak.org. lewis 3 days ago @leves the Seaside that we are using in our SqueakSource servers appears to be about 15 to 20 years old, with some local patches to keep it working in later Squeak images. I am not sure of the history behind this, but I don't think that our squeaksource servers really care what version of Seaside they are running on, just as long as it works. If you can point to any other version of Seaside that contains your alternative session registry for Seaside 2.8, then maybe we should try it? I am happy to work on it. Also sent to the channel tim 3 days ago I can aver that current-ish Seaside (3.4.etc) works decently on Squeak 6+. There's a few tweaks I have that are submitted (kinda) but not yet adopted. lewis 3 days ago I guess my question is this - since we obviously do not care about being current with Seaside (we are running a 20 year old version now), is there some runnable version of it that does contain Levente's enhancement that we could use instead? I do not care about being "up to date" I just want it to work. (edited) tim 1 day ago That's an interesting question. tim 1 day ago On one side, taking the current image and loading vente's session changes is 'simple' for certain definitions of the word. It changes as little as possible BUT leaves us running very old code. tim 1 day ago On the other side, adopting a current image and Seaside version involves more changes but brings in a couple of decades of improvements. lewis 1 day ago I'm not too interested in a couple of decades of improvements unless the improvements actually improve something. But if @leves has an alternative session registry that addresses the issues we are seeing on the squeaksource boxes, then I would be very happy to try running it regardless of what version of Seaside it uses. lewis 1 day ago I guess I should also say that I really don't know what version of Seaside we are running now for our SqueakSource services. The MCZ packages seem to be of ancient vintage so I am assuming that they might be something reasonably compatible with an alternative session registry. leves 23 hours ago IIRC you can just load the Seaside-Registry-ul.3.mcz package into Seaside 2.8 and it should work, though it was 15 years ago, so I may be wrong. :slightly_smiling_face: Anyway, I've blocked a bunch of bots from the Singaporean Alibaba cloud. Those were responsible for about 3/4 of all traffic. Since they used fake user agent string, I don't know what service they were representing. leves 23 hours ago Another bot that gets down the infinite session rabbit hole is ClaudeBot. I tried to block it via robots.txt, but it's not easy to set up robots.txt with the current nginx setup (there's already a rule for robots.txt that cannot be overriden in nginx...). lewis 23 hours ago @leves Thank you! The high system load problem on squeaksource.com and source.squeak.org seems to be resolved. I have not been able to watch closely but I think that both services have been back to normal for the last couple of days. leves 23 hours ago There was some outage ~11 hours ago. During that I decided to filter out those bots. I haven't checked the configuration of source.squeak.org, so the bots can still reach that. lewis 23 hours ago I expect that squeaksource.com is the most vulnerable due to the large number of projects to scan. But source.squeak.org would be vulnerable to the same issues so it would be good to block the bots there also. I suspect that some of the problems that @cmm has been working on (mutex and process scheduling questions) may in fact be caused by the scanning bots. leves 23 hours ago I think the bot traffic just triggers the issues. But I agree that we would be better off without the bots. Here are the user agents that sent more than 1000 requests to source.squeak.org yesterday: 1146 Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html) 2225 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) 2421 CCBot/2.0 (https://commoncrawl.org/faq/) 4260 Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) 4282 Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot) 10562 Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/) 11025 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 13001 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot) 20779 Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) 30990 Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help(a)moz.com) 95781 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) 248770 Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 406213 Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot(a)anthropic.com) leves 22 hours ago There are about 10000 requests that are not listed above from yesterday. About 10% of those is non-bot traffic. So, ~1000 requests out of ~1 million is non-bot traffic. leves 22 hours ago The 248770 requests with the fake chrome on a mac are the bots from Singapore. lewis 22 hours ago Wow, I was not aware of this at all. Thank you. And I agree with you that 1) bot traffic just triggers the issues and 2) we would be better off without the bots. I am amazed to see the amount of bot traffic.

4 7

3D graphics are hard
by Lauren Pullen 26 Apr '24

26 Apr '24

Dear List, Sometimes, your rendering code works, like in LampDemo. And sometimes it produces a secant picket fence instead of a fisheye effect. Which looks kinda cool anyways. Just thought I'd share.

5 9

Archive of Byte magazine pdfs
by Tim Rowledge 25 Apr '24

25 Apr '24

Whilst searching for history info for a project I stumbled over a pretty comprehensive archive of Byte magazine issues, running from the very first (september 1975, so 49 years ago!) up to mid 1994 (30 years ago!). This is the biggest collection I've seen for Byte issues where things seem complete. Archive.org has a lot but it seems very disorganised. There is, of course, the epic August 1981 issue - https://www.worldradiohistory.com/Archive-Byte/80s/Byte-1981-08.pdf And the ten years later review issue - https://www.worldradiohistory.com/Archive-Byte/90s/1991/Byte-1991-08.pdf And somewhere in there, in an issue I can't remember, there is a review by Dick Pountain (who was a very widely known UK industry journo for many years) of the Acorn RISC OS productised version of Eliot's BrouHaHa vm. And probably some mentions from the same writer of the Active Book. tim -- tim Rowledge; tim(a)rowledge.org; http://www.rowledge.org/tim Strange OpCodes: TDB: Transfer and Drop Bits

5 4

UKSTUG meeting - Tudor Gîrba: What exactly is Glamorous Toolkit? - 24 April 2024
by Giovanni Corriga 22 Apr '24

22 Apr '24

To some people Glamorous Toolkit is a Pharo environment. To others it’s a knowledge management system. Others might see a code analysis platform, a data visualization or an API browsing tool. Yet others see the graphical stack with its interactive editors. Glamorous Toolkit is all of these. But it’s really also none of these. These are merely examples of the many forms the environment can be molded to. And there can be many more. Glamorous Toolkit is primarily an environment that makes it possible to create many experiences seamlessly and contextually. This then leads to a new way of programming that we call Moldable Development. Tudor Gîrba is a software environmentalist and the CEO of feenk.com ( http://feenk.com/ ) where he works with an amazing team to make the inside of systems explainable. Much of the work is embodied in Glamorous Toolkit ( gtoolkit.com), a novel environment that enables moldable development. This will be an online meeting from home. If you'd like to join us, please sign up in advance on the meeting's Meetup page ( https://www.meetup.com/ukstug/events/300575234/ ) to receive the meeting details. Don’t forget to bring your laptop and drinks! (Apologies if you receive this email twice - we're in the process of moving to a new email address to send these announcements - Giovanni)

1 0

UKSTUG meeting - Tudor Gîrba: What exactly is Glamorous Toolkit? - 24 April 2024
by UK Smalltalk 22 Apr '24

22 Apr '24

1 0

Key not found: (PEGParserSAXWMGeneratorTest>>#testPageWithTable "a CompiledMethod(443890)")
by gettimothy 22 Apr '24

22 Apr '24

Hi folks, I am not sure how to handle this one.... In the test runner, or when I run a test outside of it and it fails, when I click on the Test Failure inspectorto see the output and why it failed, a window with the title in the subject line pops up. I tried garbage collecting to no avail. Suggestions appreciated. thx t Image ----- /bulkstorage/shared/Squeak6.1alpha-22713-64bit.image Squeak6.1alpha latest update: #22721 Current Change Set: Grammar Image format 68533 (64 bit) Preferred bytecode set: SistaV1 Virtual Machine --------------- /home/wm/usr/bin/sqcogspur64linuxht/lib/squeak/5.0-202206021410-64bit/squeak Open Smalltalk Cog[Spur] VM [CoInterpreterPrimitives VMMaker.oscog-dtl.3185] Unix built on Jun 2 2022 15:26:05 Compiler: Clang 9.0.0 (tags/RELEASE_900/final) platform sources revision VM: 202206021410 runner@fv-az125-921:work/opensmalltalk-vm/opensmalltalk-vm Date: Thu Jun 2 16:10:44 2022 CommitHash: c9fd365 Plugins: 202206021410 runner@fv-az125-921:work/opensmalltalk-vm/opensmalltalk-vm CoInterpreter VMMaker.oscog-dtl.3185 uuid: 0e7f07b8-eed6-4362-b223-86c98594ddb9 Jun 2 2022 StackToRegisterMappingCogit VMMaker.oscog-mt.3179 uuid: c6fbcb07-2a19-ed4f-8b40-9c119a70882a Jun 2 2022

1 0

trunk debugger unusably slow...
by Eliot Miranda 20 Apr '24

20 Apr '24

Hi All, I'm trying to debug an inlining edge case in the VM for the threaded VM that Leon is doing. The debugger is unusably slow (steps taking 10 seconds, etc). I've raised this issue before but was brushed off. I suspect somewhere in the new (last two years?) highlighting code is taking a lot of time. Would the author(s) please provide me with some snippets of code i can use to try and measure performance? And/or would anybody be willing to pair (I'm on PST) in trying to get to the bottom of this? It's extremely frustrating to try and work when the debugger is unusable. _,,,^..^,,,_ best, Eliot

5 9

The Trunk: System-mt.1454.mcz
by commits＠source.squeak.org 17 Apr '24

17 Apr '24

Marcel Taeumel uploaded a new version of System to project The Trunk: http://source.squeak.org/trunk/System-mt.1454.mcz ==================== Summary ==================== Name: System-mt.1454 Author: mt Time: 17 April 2024, 11:21:13.595706 am UUID: 5a4cbd93-f34a-5140-9d06-312754b6eb39 Ancestors: System-mt.1453 Complement FFI-Kernel-mt.232 (See PrimErrFFIMarshallingError and #ffiFail: in SqueakFFI plugin). =============== Diff against System-mt.1453 =============== Item was changed: ----- Method: SmalltalkImage>>recreateSpecialObjectsArray (in category 'special objects') ----- recreateSpecialObjectsArray "Smalltalk recreateSpecialObjectsArray" "To external package developers: **** DO NOT OVERRIDE THIS METHOD. ***** If you are writing a plugin and need additional special object(s) for your own use, use addGCRoot() function and use own, separate special objects registry " "The Special Objects Array is an array of objects used by the Squeak virtual machine. Its contents are critical and accesses to it by the VM are unchecked, so don't even think of playing here unless you know what you are doing." | newArray | newArray := Array new: 60. "Nil false and true get used throughout the VM" newArray at: 1 put: nil. newArray at: 2 put: false. newArray at: 3 put: true. "This association holds the active process (a ProcessScheduler)" newArray at: 4 put: (self specialObjectsArray at: 4) "(self bindingOf: #Processor) but it answers an Alias". "Numerous classes below used for type checking and instantiation" newArray at: 5 put: Bitmap. newArray at: 6 put: SmallInteger. newArray at: 7 put: ByteString. newArray at: 8 put: Array. newArray at: 9 put: Smalltalk. newArray at: 10 put: BoxedFloat64. newArray at: 11 put: (self globals at: #Context). newArray at: 12 put: WideString. "Was BlockContext" newArray at: 13 put: Point. newArray at: 14 put: LargePositiveInteger. newArray at: 15 put: Display. newArray at: 16 put: Message. newArray at: 17 put: CompiledMethod. newArray at: 18 put: ((self specialObjectsArray at: 18) ifNil: [Semaphore new]). "low space Semaphore" newArray at: 19 put: Semaphore. newArray at: 20 put: Character. newArray at: 21 put: #doesNotUnderstand:. newArray at: 22 put: #cannotReturn:. newArray at: 23 put: nil. "This is the process signalling low space." "An array of the 32 selectors that are compiled as special bytecodes, paired alternately with the number of arguments each takes." newArray at: 24 put: #(+ 1 - 1 < 1 > 1 <= 1 >= 1 = 1 ~= 1 * 1 / 1 \\ 1 @ 1 bitShift: 1 // 1 bitAnd: 1 bitOr: 1 at: 1 at:put: 2 size 0 next 0 nextPut: 1 atEnd 0 == 1 class 0 ~~ 1 value 0 value: 1 do: 1 new 0 new: 1 x 0 y 0 ). newArray at: 25 put: nil. "Was an array of the 255 Characters in ascii order. This is nil in Spur, which has immediate Characters." newArray at: 26 put: #mustBeBoolean. newArray at: 27 put: ByteArray. newArray at: 28 put: Process. "An array of up to 31 classes whose instances will have compact headers; an empty array in Spur" newArray at: 29 put: self compactClassesArray. newArray at: 30 put: ((self specialObjectsArray at: 30) ifNil: [Semaphore new]). "delay Semaphore" newArray at: 31 put: ((self specialObjectsArray at: 31) ifNil: [Semaphore new]). "user interrupt Semaphore" "Entries 32 - 34 unreferenced. Previously these contained prototype instances to be copied for fast initialization" newArray at: 32 put: DoubleByteArray. "was the prototype Float" newArray at: 33 put: WordArray. "was the prototype 4-byte LargePositiveInteger" newArray at: 34 put: DoubleWordArray. "was the prototype Point" newArray at: 35 put: #cannotInterpret:. newArray at: 36 put: nil. "was the prototype MethodContext" newArray at: 37 put: BlockClosure. newArray at: 38 put: (self at: #FullBlockClosure ifAbsent: []). "was the prototype BlockContext" "array of objects referred to by external code" newArray at: 39 put: (self specialObjectsArray at: 39). "external semaphores" newArray at: 40 put: nil. "Reserved for Mutex in Cog VMs" newArray at: 41 put: ((self specialObjectsArray at: 41) ifNil: [LinkedList new]). "Reserved for a LinkedList instance for overlapped calls in CogMT" newArray at: 42 put: ((self specialObjectsArray at: 42) ifNil: [Semaphore new]). "finalization Semaphore" newArray at: 43 put: LargeNegativeInteger. "External objects for callout. Note: Written so that one can actually completely remove the FFI." newArray at: 44 put: (self at: #ExternalAddress ifAbsent: []). newArray at: 45 put: (self at: #ExternalStructure ifAbsent: []). newArray at: 46 put: (self at: #ExternalData ifAbsent: []). newArray at: 47 put: (self at: #ExternalFunction ifAbsent: []). newArray at: 48 put: (self at: #ExternalLibrary ifAbsent: []). newArray at: 49 put: #aboutToReturn:through:. newArray at: 50 put: #run:with:in:. "51 reserved for immutability message" newArray at: 51 put: #attemptToAssign:withIndex:. newArray at: 52 put: #(nil "nil => generic error" #'bad receiver' #'bad argument' #'bad index' #'bad number of arguments' #'inappropriate operation' #'unsupported operation' #'no modification' #'insufficient object memory' #'insufficient C memory' #'not found' #'bad method' #'internal error in named primitive machinery' #'object may move' #'resource limit exceeded' #'object is pinned' #'primitive write beyond end of object' #'object moved' #'object not pinned' #'callback error'), { PrimitiveError new errorName: #'operating system error'; yourself. ExceptionInFFICallError new errorName: #'exception in FFI call'; yourself}, #( #'heap compaction needed' #'operation failed' + #'internal error' #'uninitialized'), + { PrimitiveError new errorName: #'FFI marshalling error'; yourself}. - #'internal error' #'uninitialized'). "53 to 55 are for Alien" newArray at: 53 put: (self at: #Alien ifAbsent: []). newArray at: 54 put: #invokeCallbackContext:. "use invokeCallback:stack:registers:jmpbuf: for old Alien callbacks." newArray at: 55 put: (self at: #UnsafeAlien ifAbsent: []). "Used to be WeakFinalizationList for WeakFinalizationList hasNewFinalization, obsoleted by ephemeron support." newArray at: 56 put: nil. "reserved for foreign callback process" newArray at: 57 put: (self specialObjectsArray at: 57 ifAbsent: []). newArray at: 58 put: #unusedBytecode. "59 reserved for Sista counter tripped message" newArray at: 59 put: #conditionalBranchCounterTrippedOn:. "60 reserved for Sista class trap message" newArray at: 60 put: #classTrapFor:. "Now replace the virtual machine's reference in one atomic operation" self specialObjectsArray becomeForward: newArray! Item was changed: + (PackageInfo named: 'System') postscript: 'SystemNavigation initializeAuthors. "Adds Leon Matthes (LM)" + Smalltalk recreateSpecialObjectsArray. "Adds ffi-marshalling-error to error table"'! - (PackageInfo named: 'System') postscript: '"In Process, threadId/threadAffinity have been around for a long time." - Smalltalk processHasThreadAffinityInstVar: true. - "Squeak 6.0 and above have #scaleFactor support in image." - Smalltalk upscaleDisplayOnHighDPI: false. - - SystemNavigation initializeAuthors. "Adds Leon Matthes (LM)"'!

1 0

Jump to page: