Disk Failure, Outlook, SMART, Ceph, SDDC, DDoS, Taltio, SQL, Projects

Post date: Dec 18, 2016 3:36:30 PM

• Read: Predicting Disk Replacement towards Reliable Data Centers [PDF] - Very nice, combining statisics, machine learning and hard disk failure prediction. Multiple of my favorite topics in one post. KW: Predictive Failure Analysis (PFA), SMART, RAID, storage system, data center, MTTF, Bayesian methods, Machine Learning, Reliability, Data Analysis, Data Analytics, Predictive Models, Statistical Analysis, Transfer Learning, Classification, Classifier, Decision Trees, Logistic Regression, Support Vector Machines, Random Forests, K-means, Compact Time Series, Informative Downsampling, Algorithms, Availability, Automatic Forecasting.
• This is already old stuff, but here's a similar post by Backblaze. What SMART Stats Tell us About Hard Drives.
• This was actually a perfect timing. I've been complaining so much about Ceph and related performance issues lately. Yet I'm quite sure those aren't affected by a few disks failing.
• Outlook sucks again. Now it blocked more email from Outlook to Outlook. I think this is ridiculous. Yet MS has no interest in fixing these. - I guess the only sane conclusion made from this is that you either choose to use crappy Outlook, which is stupid. Or you're so stupid you don't care. I haven't yet decided which of those groups I personally belong to. Sigh. But as said, Cloud Services aren't nearly as awesome as usually advertised. There are deep and annoying problems with those too. It's not always clear, it would be better than running your own systems.
• Server stuff: Software Defined Data Center (including Software Defined Network, Software Defined Storage), vSphere, Cloud, VSAN, Pricate Cloud, NSX, NFS, VXLAN.
• Ceph - Performance - Deep sigh - Nuff said - Event log: A request to write to the file "...\Logs\edb.log" at offset 1105920 (0x000000000010e000) for 4096 (0x00001000) bytes succeeded, but took an abnormally long time (26 seconds) to be serviced by the OS. This problem is likely due to faulty hardware. Please contact your hardware vendor for further assistance diagnosing the problem.
• OVH DDoS mitigation, really nice article: The DDoS that didn't break the camel's VAC* - Lot of same stuff as in CloudFlare's massive DDoS attack report "Say Cheese: a snapshot of the massive DDoS attacks coming from IoT cameras" - mentioned in their DDoS mitigation article I mentioned a few posts ago. It's nice that they can handle DDoS attacks up to 5 Tbps in near future. That's quite good capability. Internet of Things is becoming reality, but this is what we've all been expecting, so no news.
• So many integration talks and projects going on again. Yet surprisingly little coding and getting stuff actually done. Most of integrations are very simple, but getting the information required before it makes any sense to even start building code / integration, is the hardest part. When it's clear what should be done and how, then it's just few quiet moments and putting it all together.
• Attended Taltio seminar. It's about Digitalization, RTE, e-Receipt, Accounting, Payroll, Taxation, Archiving, Reporting, Payments, VAT, Fintec, National Registers, Structured Data and generally agreeing about data formats and methods how to digitalize the processes currently being handled using 'legacy papers'. Important part of all this is also accurate and real-time information of current state of things.
• Studeid SQL Style Guide - I didn't like some of the aspects, like using the 'as' bit too often. If names are short and clear, I would prefer using full names instead of using as statement. Just like when programming of course I could do stuff like a = this_long_stuff_object_instance and b = yet_another_annoyingly_long_name. And then just fer to b.set(a.get()) or something like that. But as long as names aren't really long, I'll usually avoid doing that unless it for some reason somehow clarifies what's happening.
• Consults, Developers and Project Managers need to deliver. Otherwise they won't be trusted. Trust to get things delivered and done, is the only reason why clients are purchasing your services.