What is the tallest SCP ever?
Transferring large (8 GB) files over ssh
Any idea what could be wrong? Don’t SCP and SFTP support files that are larger than 2 GB? If so, then how can I transfer bigger files over SSH? The destination file system is ext4. The Linux distribution is CentOS 6.5. The filesystem currently has (accessible) large files on it (up to 100 GB).
Follow
65.8k 34 34 gold badges 106 106 silver badges 242 242 bronze badges
asked Mar 16, 2015 at 16:59
eimrek eimrek
543 1 1 gold badge 5 5 silver badges 9 9 bronze badges
Looks like a variable overrun of size. But AFAIK scp/sftp has no size limit. What is the destination file system? Does it support LARGEFILES?
Mar 16, 2015 at 17:09
What about the applications sftp and scp? You can find this out using the file command against their binaries.
Mar 16, 2015 at 18:54
@shepherd — yes.
Mar 16, 2015 at 19:12
32-bit applications can access large files if they’re compiled with -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64 . But if you’re running a 64-bit 6.5 system, it’d probably be easier to have the admins install openssh-5.3p1-94.el6_6.1.x86_64 and openssh-server-5.3p1-94.el6_6.1.x86_64 from the standard repos.
Mar 16, 2015 at 21:02
lol at software using signed integers for file size
Mar 17, 2015 at 17:04
3 Answers 3
Sorted by: Reset to default
Rsync is very well suited for transferring large files over ssh because it is able to continue transfers that were interrupted due to some reason. Since it uses hash functions to detect equal file blocks the continue feature is quite robust.
It is kind of surprising that your sftp / scp versions does not seem to support large files — even with 32 Bit binaries, LFS support should be pretty standard, nowadays.
Follow
answered Mar 16, 2015 at 20:38
maxschlepzig maxschlepzig
55.5k 48 48 gold badges 201 201 silver badges 272 272 bronze badges
Given that a large part of the file is already transferred, rsync is a good idea now. Use the -P option to both get progress indication and instruct the receiver to keep an incomplete file in case the transfer is interrupted again.
Mar 17, 2015 at 0:02
I’m not sure about the file size limits of SCP and SFTP, but you might try working around the problem with split:
split -b 1G matlab.iso This will create 1 GiB files which, by default, are named as xaa, xab, xac, . . You could then use scp to transfer the files:
scp xa* xxx@xxx: Then on the remote system recreate the originial file with cat:
cat xa* > matlab.iso Of course, the penalties for this workaround are the time taken in the split and cat operations, as well as the extra disk space needed on the local and remote systems.
Follow
answered Mar 16, 2015 at 17:23
SpinUp __ A Davis SpinUp __ A Davis
548 5 5 silver badges 10 10 bronze badges
good idea. I already transferred the file with an usb drive, but this would have probably been more convenient. Not as convenient as getting scp and sftp to work correctly, though.
Mar 16, 2015 at 17:46
to note, I had to send a 4GB+ file to ArcaOS. Had to use this option.
Dec 21, 2022 at 0:35
The original problem (based on reading all comments to the OP question) was that the scp executable on the 64-bit system was a 32-bit application. A 32-bit application that isn’t compiled with «large-file support» ends up with seek pointers that are limited to 2^32 =~ 4GB .
You may tell if scp is 32-bit by using the file command:
file `which scp` On most modern systems it will be 64-bit, so no file truncation would occur:
$ file `which scp` /usr/bin/scp: ELF 64-bit LSB shared object, x86-64 . A 32-application should still be able to support «large files» but it has to be compiled from source with large-file support which this case apparently wasn’t.
The recommended solution is perhaps to use a full standard 64-bit distribution where apps are compiled as 64-bit by default.
The 10 best SCP games, ranked
Collaborative writing has really taken off with the advent of the internet, and there are few better examples of that than the SCP Foundation. The acronym stands for Special Containment Procedures (or sometimes Protocols). It started off as a quasi-wiki project where contributors added to the growing library of creative horror and sci-fi contributions and stories, and has taken the greater horror community by storm. They all revolve around the capture and containment of various paranormal entities of different types and magnitudes, and as with everything creative, it was only a matter of time before games sprung up around it.
There have been several dozen (mostly) indie games with SCP themes released over the years. Below, we will take you through our picks for the top 10 that you have to try if you’re a horror fan.
The best SCP games to play
10. SCP: Strategy
Unlike many other SCP-related games, SCP: Strategy relies less on the horror aspects and leans more into the containment and management aspects. That gives the player a more strategic backseat view of the premise, while also featuring many of the phenomena and stories that make SCP so engaging.
9. SCP: Fragmented Minds
This survival horror game puts you front and center in the middle of a containment breach on Mars Site 113. The entities are out and hunting survivors, and it is your only task to escape and warn others of what has happened. SCP: Fragmented Minds has not been released yet, but there is a playable demo that you can try out for yourself.
8. SCP: Keter
Keter-class anomalies in SCP rank among the highest risk/danger classes in the organization’s fictional universe. Therefore you know you’re in for a spooky time when the game bears this title. It’s planned to be an asymmetric PVP game, taking heavy influence from games like Dead by Daylight. SCP: Keter is currently still in early access, but looks like a very promising title already.
7. SCP: Containment Breach
Unlike some of the other titles, this game is free to play and made by the fans. It was also one of the earliest decent attempts at an SCP game, with the title now boasting both Remastered and Multiplayer versions. The title of the game puts it pretty clearly — you are trapped during a containment breach and have to get out.
6. The Store is Closed
Being the only title without SCP in its name on our list does not make The Store is Closed any less scary, nor any less of an SCP title. It revolves around SCP-3008, which in itself is a shopper’s nightmare. Put that in a game (funded through Kickstarter no less) and you get a neat co-op crafting & survival game.
5. SCP: Blackout
In what’s becoming a pattern, you play as a D-Class personnel member trapped in an SCP facility that’s had a breach. Now you have to escape and survive while following clues left by those less fortunate. So what’s the twist? SCP: Blackout is a VR game, that gets you fully immersed in the unfolding horror.
4. SCP: Labrat
With back-to-back VR titles, what sets SCP: Labrat apart is that it’s got an even scarier atmosphere in VR than the previous game. This is impressive considering that the game was made on a shoestring budget and is a free title. But that’s even more of a reason to give it a try, right?
3. SCP: Secret Laboratory
SCP: Secret Laboratory comes out of the gates swinging when it comes to the ways it curbs the norm for SCP games. Yes, there’s still a containment breach, as expected, but this time — you get to choose what you play as. You can be part of the security, an insurgent, or even an SCP entity yourself. And there’s even a PVP option, all of that in a free SCP game.
2. SCP: Pandemic
Going a bit topical when it comes to the title, we offer SCP: Pandemic as another early access release. Gameplay-wise, it is meant to be a co-op tactical FPS game with horror elements, and the story is based around SCP-5000 and surrounding events.
1. SCP: Secret Files
The best game based around SCP takes very little in action or even straight-up horror and dabbles more in mystery and existential dread. SCP: Secret Files puts you in a position of an assistant to an SCP researcher, giving you a front-row seat to observe and eventually unravel a deep story that exposes the many flaws of the SCP Foundation.
Honorable mentions
Because we have been talking about atmospheric horror a lot — which is one of the hallmarks of SCP stories in the first place — there are some other famous games that can give you that SCP vibe while playing them but are not directly related to it:
SCP: The Largest Online Shared Universe is Under Legal Attack
SCP is the largest online shared universe around. It’s also on the brink of destruction thanks to a legal attack. Here’s what you need to know.
SCP Foundation launched back in 2008 and has since grown into one of the biggest online writing communities around. The SCP Wiki outlines several fantastic and sometimes horrific entities, collected and cataloged in the Foundation. The Foundation’s in-universe goal is to contain these sometimes dangerous and sometimes bewildering entities for the public’s safety.
It’s real-life purpose, however, is to offer a community of writers the opportunity to collaborate and craft the most outlandish entities imaginable. It has flourished in the years since its creation thanks in part to the game SCP Containment Breach, an independent game that has taken the internet by storm, partially because it’s been the subject of multiple popular Let’s Players, such as Markiplier.
However, all that hard work may soon be eradicated thanks to a Russian trademark for SCP filed by one Andrey Duskin. This issue has been ongoing for the better part of a year, but many people learned about it for the first time when Markiplier posted a video about it to his YouTube channel. However, there are specifics Markiplier didn’t go into detail on, so this article will offer more context to better understand the situation.
The Situation
SCP is registered under a Creative Commons copyright license. A CC License allows people other than the author to share, use and build upon a creative work free of charge and without any legal repercussions. Because of this license, anyone can create merchandise off the SCP brand. This is why SCP Containment Breach not only exists but is also just one of multiple SCP-related games. In short, if you wanted to tell a story in the SCP universe, you could right now. That’s one of the many reasons this universe has grown so vastly in such a short period of time.
Months ago, Duskin filed a trademark for SCP after attempting to sell merchandise based on the work. He’s allowed to do so, but he used his trademark to bully and push down potential competition. While the situation seemed resolved for a time , things have since escalated. Over two months ago, Duskin used his trademark to suppress and shutter the legitimate Russian branch of the SCP Foundation. The main site could do little to nothing about the matter since Duskin’s legal foothold gives him an air of legitimacy in Russia.
So What Does This Mean Outside of Russia?
This might not seem as important outside of Russia. After all, Duskin’s trademark doesn’t extend beyond that country, right? Well, that’s the thing. If left unchecked, Duskin’s trademark could, in fact, affect all of SCP outside of Russia, too. If he was able to legitimately take down entire pages of work for SCP, that means Russian contributors to the site can no longer share, which cuts into SCP’s core appeal: that every writer, regardless of their status or connection to the work, can collaborate.
On top of that, many countries do honor international copyright. If Duskin succeeded in Russia, it’s highly possible he might push even further, registering an international trademark. Or, worse yet, he could use his trademark as leverage against other country’s potential trademarks.
The prospective legal battle over the SCP trademark could also lead to further division over the Creative Commons copyright license as a concept. If anyone can just register a trademark and then own what isn’t theirs by default, what’s stopping them from doing that to any other work in the Creative Commons? The whole matter has far-reaching implications that could very possibly strip this important cultural icon from the internet.
What is Being Done?
At the time of this writing, a legal fund has been started. While it has reached its goal, there is no telling how costly the lawsuit will become.
The SCP Reddit announced shortly after Markiplier’s video was posted that legal documents had finally been submitted to the Russian Federal Antimonopoly Service. That means the real struggle starts now: the legal battle over Duskin’s trademark. The results of this could have an international ripple effect on Creative Commons, but more than that, it will decide the fate of the SCP community as a whole.
With any luck, this will be sorted out and things will return to the way they were. However, it is a story that should remind everyone that while online culture is a place where the greatest of narratives can flourish, people can also ruin things just because they want money. Hopefully the SCP Foundation can continue to secure, contain and protect all those eldritch monsters that haunt our nightmares and fuel our fantasies.
