Tsallake zuwa abun ciki
Kayan aikin sarrafa kansu, isarwa a ko’ina cikin duniya
Why Did a $420,000 Shutdown Happen Despite CPU Redundancy?

Me Ya Sa An Samu Rufe Aiki Na $420,000 Duk da Saurin-Mayen CPU?

Wannan labarin ya gabatar da shaidun aikace‑aikacen fili na tsawon shekaru 15 da ke nuna yadda boyayyun mahimman wuraren gazawa guda ɗaya ke haifar da rufe shuka ba tare da shiri ba duk da samun ɗan ninkewar tsarin DCS. Bayanai na ainihin shuka daga wata masana’antar ammonia sun nuna watanni 18 ba tare da wani rufewa ba bayan shigar da ABB System 800xA. Wani cikakken nazarin shari’ar tashar fitar da LNG ta teku ya tabbatar da guje wa asarar dala miliyan $7.5.

Dalilin Da Ya Sa Yawancin Tsare-tsaren DCS Redundancy Ke Yaudararka (Amma ABB Ba Haka Ba Ne)

Na taɓa kallo wata masana’antar sinadarai ta dala biliyan 2 ta yi asarar $420,000 cikin mintuna 47. Abin laifin shi ne ƙaramin sashin wutar lantarki guda ɗaya mai darajar $800 a cikin mai sarrafa da ba a maimaita shi ba. Wannan daren ne ya sake fasalin yadda nake tantance gine-ginen tsarin sarrafawa. Wannan labarin yana kawo darussan gyaran matsalolin otomeshan na shekaru 15. Za ka gano inda tsarin redundancy na gargajiya ke ɓoye wuraren gazawa guda ɗaya da kuma yadda ABB System 800xA ke kawar da su ba tare da tilasta sake gina dukan masana’anta ba.

Dakatarwar Minti 47 Da Ta Sauya Mini Dabara

Wata sashen hydrocracker matsakaici ta fuskanci bala’i da za a iya kauce wa shi. Masana’antar ta yi amfani da sanannen nau’in DCS tare da CPU redundancy da aka kunna. Sai dai, dukkan masu sarrafa da aka ninka biyun suna raba wutar backplane ɗaya. Lokacin da wannan wutar ta gaza, dukkan CPUs ɗin biyu sun rasa wuta a lokaci guda. Sashen ya tsaya cak saboda asarar sadarwa. Ma’aikata ba su ga bayanan ƙararrawa ba na tsawon daƙiƙa 12.

Bari in warwale ainihin kuɗin da aka yi asara daga wannan al’amari:

  • Asarar ƙera kayayyaki (mintuna 47 a 380 ganguna/awa): $298,000
  • Tara na muhalli na tsarin flare: $87,000
  • Lalata katalis ta hanyar sauya zafi-ɗumi: $35,000
  • Jimillar asarar kai tsaye: $420,000

Ƙungiyar kula da kayan aiki ta maye gurbin wutar da ta lalace da $800 washegari. Wannan shi ne tarko ɓoye na redundancy na ɓangare kaɗan. Injiniyoyi da dama suna yarda da lakabin redundancy ba tare da tantance ainihin abin da ya rufe ba.

Manyan Imani Uku Masu Hadari Da Nake Gyara A Kowane Binciken Masana’anta

Bayan shekaru 15 na aiki a filin, ina ganin irin waɗannan kuskuren fahimta suna maimaituwa. Ga manyan zato uku marasa kyau da ke haddasa tsaikon aiki ba tare da shiri ba:

Imani na 1: "Masu sarrafa da aka ninka suna nufin kariya ta cikakken tsarin." Ba daidai ba ne. Koyaushe duba hanyoyin wutar lantarki, mahaɗan backplane, da adaftan bas ɗin I/O. Sashi guda da ake rabawa yana lalata duk ƙirar.

Imani na 2: "Redundancy na hanyar sadarwa yana magance duk gazawar sadarwa." Ba daidai ba ne. Sau da yawa ƙirar cibiyoyi biyu suna amfani da na’urar sauya hanya guda ɗaya mai tashoshi biyu, ba na’urori biyu masu zaman kansu ba. Wannan yana haifar da ɓoyayyen wuri guda na gazawa.

Imani na 3: "Canja wuri ta atomatik kullum yana aiki daidai." Ba daidai ba ne. Idan ba a yi daidaita matsayin bayanai sosai ba, canja wuri na iya lalata ƙimomin tsari kuma ya haifar da tsalle-tsallen tsarin aiwatarwa.

Yadda ABB System 800xA Redundancy Ke Aiki Gaskiya Lokacin Da Aka Samu Kuskure

Na gudanar da gwajin saka kuskure a cikin yanayi mai sarrafawa a wata masana'antar sinadarai na musamman a 2023. Mun yi gangan muka kasa manyan sassa biyar na tsarin yayin da muke saka idanu kan aikin madauwari. Ga abin da muka auna:

  • Gazawar Babban CPU: amsa 9 ms, karkacewar tsari 0.02%, babu sanin mai aiki
  • Gazawar babban na'urar sauya hanyar sadarwa: amsa mai santsi na 0 ms, karkacewa 0.00%, babu sanin mai aiki
  • Gazawar wutar uwar garken: amsa 4 ms, karkacewa 0.01%, babu sanin mai aiki
  • Gazawar adaftan bas na I/O: amsa 11 ms, karkacewa 0.03%, babu sanin mai aiki
  • Gazawar tushen daidaita agogo: 0 ms tare da voting logic, karkacewa 0.00%, babu sanin mai aiki

Tsarin ABB ya kiyaye sarrafa loop cikin kuskuren 0.03% ne kawai a duk lokacin gazawar. Masu aiki sun ruwaito cewa babu wani ƙararrawar tsari face sanarwar gazawar da kanta. Wannan matakin aiki ba ƙididdiga ba ne kawai. An ciro shi ne daga ainihin bayanan shuka.

Ƙa'idar RNRP ta Warware Wani Matsala da Ba ka San Tana Akwai ba

Kafaffen hanyoyin sadarwa masu maimaita aiki na gargajiya suna dogara ne kan spanning tree protocol (STP) ko rapid STP. Lokacin murmurewa yawanci yana tsakanin milisekondi 200 zuwa daƙiƙu da dama. Ga saurin loops na analog kamar sarrafa surgen compressor, milisekondi 200 na haifar da ƙarin girgiza tsarin da ake iya aunawa kuma mai haɗari.

ABB ta haɓaka RNRP (Redundant Network Routing Protocol) ne musamman don aikace-aikacen sarrafawa na ainihin lokaci. Dawowa daga gazawa na kammaluwa cikin sifili milisekondi ga yawancin yanayin gazawa. Ta yaya wannan ke aiki? Ƙa'idar tana sa hanyoyin sadarwa biyu su kasance masu aiki gaba ɗaya a lokaci guda. Fakiti suna tafiya ta kowace hanya lokaci guda. Na'urar karɓa tana karɓar fakitin da ya iso na farko kuma tana watsar da wanda ya maimaitu. Babu wani canjin hanya (switchover) saboda babu hanyar jira.

Wannan ƙirar tana da matuƙar muhimmanci don hana surgen compressor mai juyawa (centrifugal) da kuma sarrafa zafin jikin reactor. Gibin sadarwa na milisekondi 200 na iya sanya compressor ya tsaya ba zato ba tsammani. Hanyar ABB RNRP tana kawar da wannan haɗarin ƙwarai.

Haqiƙanin Bayanai na Ayyuka daga Watanni 18 na Aiki Ba Tare da Yankewa ba

Wani shuka na takin ammonia a yankin Midwest ya koma amfani da DCS mai maimaita aiki na ABB System 800xA a shekarar 2022. Sashen kula da kayan aikin su ya raba bayanan gazawa da aka ɓoye sunaye da ni. Wurin shukar na aiki sa'o'i 8,760 a kowace shekara tare da tazarar tsayawa biyu da aka tsara.

Gazawar kayan aiki da suka faru cikin watanni 18: Sassan wutar lantarki guda uku sun gaza saboda tsufewar ƙwayoyin capacitor. Fan ɗin na'urar sauya hanyar sadarwa guda ɗaya ya gaza kuma aka maye gurbinsa ba tare da kashe tsarin ba. Modules I/O guda biyu sun nuna matsalolin tashoshi na ɗan lokaci-ɗan lokaci. Babban CPU guda ɗaya ta fuskanci karkacewar da'irar agogo.

Halin aikin tsarin a lokacin kowace gazawa: Babu dakatar da samarwa ba zato ba tsammani. Babu buƙatar shiga tsakani daga mai aiki. Babu tayar da ayyukan kayan aikin tsaro (safety instrumented function). Matsakaicin lokacin maye gurbin kuskure ya kasance mintuna 14 tare da maye gurbi kai tsaye (online hot swapping).

Tasirin kuɗi idan aka kwatanta da tsohon tsarin: Tsohon DCS da ke da ɓangaren maimaitawa ya kan yi matsakaicin dakatar da aiki ba tare da shiri ba har sau 2.2 a shekara. ABB System 800xA ta bayar da sifili na dakatar da aiki ba tare da shiri ba a cikin watanni 18. An kiyasta ajiya na shekara-shekara ya kai dala miliyan $1.6 bisa kimar samarwar shuka.

Wani ma’aikacin kula da kayan aiki ya faɗa mini wani abu da bai manta min ba. “Da can muna tsoron faɗakarwar kayan aiki. Yanzu dai sai mu ba da odar sabon sashi mu maye gurbinsa lokacin cin abincin rana.” Wannan shi ne ainihin yanayin aiki na tsarin maimaitawa a matakai gaba ɗaya.

Dalilin da ya sa Yawancin Shuke-shuke Ba Su Taɓa Kai Wannan Matakin Aiki Ba

Fasaha kaɗai ba ta tabbatar da sakamako ba. Bayan ziyartar fiye da wuraren aiki 40, na gano manyan ɗabi'un aiki guda uku da ke bambanta nasara da rashin gamsuwa.

Discipline 1: Gwajin sauyawa kowane wata yayin ɗaukar nauyin samarwa na yau da kullum. Shuke-shuke da yawa suna tsallake wannan saboda haɗarin da suke zato. Gaskiyar haɗari shi ne yin sauyawa da ba a taɓa gwadawa ba lokacin da gazawa ta ainihi ta faru. ABB tana samar da kayan aikin bincike na ciki don kwaikwayon sauyawa cikin aminci.

Discipline 2: Jarin kayan ajiya na modules da ya yi dai-dai da kowane sashi mai maimaituwa. Ƙananan kayan ajiya suna tilasta jinkirin gyare-gyare da tsawaita tagogin haɗari.

Discipline 3: Tsare-tsare masu bayyana don maye gurbin kayan aiki a kan layi tare da yin atisaye akai-akai. Injiniyoyi suna buƙatar “muscle memory” kafin gaggawa ta faru.

Ina ba da shawarar gudanar da gwaje-gwajen kuskure na kwaikwayo kowane kwanaki 90. Tsarin na iya gwada sauyawa ba tare da tasiri ga I/O na ainihi ba. Wannan ɗabi’a mai sauƙi na hana yawancin gazawar tsarin maimaitawa.

Fa’idar Haɗin SIL 3 da Yawancin Injiniyoyi ke Watsarwa

Shuke-shuke da dama suna aiki da tsarin kula da aikin tushe (BPCS) tare da raba tsarin kayan aikin tsaro (SIS). Kowanne tsarin yana da nasa masu kula, hanyoyin sadarwa, tashoshin aikin injiniya, da hanyoyin kulawa. Wannan rarrabuwar tana haifar da ɓoyayyun matsalolin haɗin kai masu zama maki guda na gazawa.

Yi la’akari da ainihin yanayi daga wani shuka na sinadarai a Gulf Coast. BPCS ta rasa babban mai kula nata. Canjawa ta atomatik zuwa madadin mai kula ta yi aiki daidai. Sai dai kuma, BPCS ta rasa sadarwa da raba na’urar warware dabarun SIS yayin sauyawar da ta ɗauki ms 200. SIS ta fassara wannan a matsayin yanayin rasa iko, ta tayar da gaggawar tsarin kashewa duk da cewa aikin ya kasance a daidaitacce.

ABB System 800xA yana haɗa tsaro da sarrafawa a kan dandali guda mai maimaituwa. Mai warware lissafin tsaro yana aiki a kan na’ura mai zaman kanta amma yana amfani da wannan gabar hanyar sadarwa mai maimaituwa ɗaya da kuma muhallin injiniya ɗaya. Faduwar BPCS controller zuwa na’ura ta madadin baya haifar da giɓin sadarwa da ayyukan tsaro. Tsarin yana ci gaba da riƙe takardar shaidar SIL 3 yayin da yake kawar da mahimman wuraren gazawar da ke tasowa daga rashin daidaiton aiki.

Misalin Aiki: Tashar Fitar LNG Ta Kauce wa Asara ta Dala Miliyan 7

Wani tashar fitar da liquefied natural gas (LNG) a gabar tekun Gulf ta Amurka ta fuskanci sanannen haɗari. DCS ɗinsu na yanzu na da maimaituwar CPU amma na’urar sauya hanya guda ɗaya (single network switches). Gazawar switch a lokacin kololuwar fitarwa zai haifar da tsayawar masana’anta. Sake kunna jiragen LNG yana ɗaukar sa’o’i 36 kuma yana kashe kusan dala miliyan $2.5 ga kowane jirgi. Wurin yana da jirage uku.

Ƙungiyar injiniyoyi ta zaɓi ABB System 800xA tare da cikakkiyar maimaituwa a kowane mataki. Bukatun sun haɗa da zoben fiber biyu masu zaman kansu tare da ka’idar RNRP, na’urorin sarrafa hot‑standby masu daidaita ƙwaƙwalwar jiha, ma’auratan uwayen sabar (server) masu maimaituwa tare da canjawa ta atomatik idan ɗaya ta gaza, da hanyoyin wutar lantarki biyu zuwa kowace I/O rack.

Watanni tara bayan girkawa, motar tono ƙasa (backhoe) ta sare ɗaya daga cikin zoben fiber optic biyu yayin aikin haƙa. Ga abin da ya faru daidai:

A lokacin sifili, yankan fiber ɗin ya faru a Ring A. Bayan millisekan guda, Ring B ta ci gaba da ɗaukar duk zirga‑zirgar bayanai ba tare da wata tangarda ba. A millisekan biyu, tsarin ya yi rajistar sanarwar kuskure. A cikin daƙiƙa 14, ma’aikatan kula da gyare‑gyare suka karɓi faɗakarwa. A daƙiƙa 45, masu aiki suka tabbatar babu wani tangarda a tsari. Masana’antar ta ci gaba da samar da LNG a cikakke ba tare da yankewa ba.

Ƙungiyar kula da gyara ta gyara igiyar fiber da aka yanke bayan sa’o’i huɗu. Suka sake haɗa Ring A ba tare da wani katsewar tsarin ba. Ba wani mai aiki da ya lura da abin da ya faru sai dai shigar da kuskure a cikin log. Sakamakon kuɗi shi ne babu asarar samarwa. Tsarin da ya yi kama da wannan ba tare da cikakkiyar maimaitawar hanyar sadarwa ba da alama zai kashe aƙalla jirgin LNG ɗaya. Kimar asarar da aka kauce mata ta fara daga dala miliyan $2.5 zuwa dala miliyan $7.5 gwargwadon yawan jirage da lokacin sake kunna su.

Tattalin Arzikin Cikakkiyar Maimaituwa Yana Rama Kuɗinsa Da Sauri

Ina kan ji wannan korafi akai‑akai. “Cikakkiyar maimaituwa tana ƙara kashi 25 zuwa 35 cikin ɗari a farashin DCS na farko.” Wannan magana gaskiya ce amma tana ruɗarwa. Bari in nuna lissafin dawo da jari mai sauƙi daga wani ainihin aikin shekarar 2024.

Bayanan aikin (Project profile): Matsakaciyar masana’antar sinadarai mai maki 1200 na I/O da aiki ba tare da yankewa ba. Kuɗin asalin DCS ba tare da maimaituwa ba ya kasance $850,000. Cikakken tsarin ABB redundant System 800xA ya kasance $1,150,000. Ƙarin kuɗin da aka biya saboda maimaituwa ya kasance $300,000.

Kwatancen kuɗi: Jimillar kuɗin tsayawar gaggawa na shekara tare da asalin DCS ya kai $1,200,000 bisa tarihin shekaru uku na shukar. Jimillar kuɗin tsayawar gaggawa na shekara tare da ABB redundant DCS ya kasance $120,000 yana wakiltar sauran haɗurruka kamar gazawar na’urorin filin (field devices). Adadin tanadin shekara-shekara daga cikakkiyar maimaituwa ya kai $1,080,000.

Lokacin dawo da jari (Payback period): $300,000 an raba shi da $1,080,000 ya bada sakamakon watanni 3.3. Shukar ta dawo da jarinta kafin ta kammala zangon aikin farko. Kowanne wata daga baya ya samar da fiye da $90,000 na ƙarin riba daga guje wa lokutan tsayawa.

Lura kan Wasu Hanyoyin Cigaban Masana’antu da Ke Damuna

Edge computing da nazarin hasashen bayanai (predictive analytics) kayan aiki ne masu amfani. Ba za su iya maye gurbin ginshikin maimaituwar kayan aiki (hardware redundancy) ba. Ina ganin wasu masu kaya suna tallata wayayyun na’urorin gano matsala a matsayin madadin tsarin “hot backup”. Wannan shawara ce mai haɗari ga masana’antu masu ci gaba ba tare da yankewa ba.

Na’urorin gano matsala suna gaya maka cewa gazawa na iya faruwa. Tsarin maimaituwa ne ke ci gaba da aiki lokacin da wannan gazawa ta auku a zahiri. Kana buƙatar wadannan ƙwarewa biyu. ABB ta daidaita wannan sosai ta hanyar ƙara fasalullukan kula da kiyayya (predictive maintenance) a kan ginin tsarin da yake maimaituwa tun asali. Kada ka bari wani ya shawo kanka akasin haka.

Takaitawa ga Injiniyoyin Keɓancewa (Automation Engineers) da Manajojin Shuka

Tsayawar gaggawa ba hatsarin aiki ba ne. Sakamakon ƙira ne. Kowanne wuri na kuskure guda ɗaya da aka bari a cikin tsarin kulawarka yana wakiltar wani tsayawar shuka a nan gaba da yake jiran ya faru. ABB System 800xA yana tabbatar da cewa cikakkiyar maimaituwa a matakai daban-daban abu ne mai yiwuwa a fasaha kuma mai ma’ana a tattalin arziki. Tsarin ya kawar da matsalolin kuskure guda ɗaya a matakin na’urar sarrafawa, hanyar sadarwa, uwar garke, da wutar lantarki. Ainihin masana’antu sun tabbatar da wannan aiki a ƙarƙashin yanayin gazawa na hakika tare da sakamakon da aka rubuta. Lokutan dawo da jarin da suka kasa watanni shida suna sa wannan saka jari ya zamo da wuya a ƙi shi.

Shawarata bayan shekaru 15 a fannin tana da sauƙi. Yi bincike kan tsarin kulawarka na yanzu don gano ɓoyayyun wuraren kuskure guda ɗaya da ka dogara da su. Kwatanta kuɗin cikakkiyar maimaituwa da tarihin tsayawar gaggawa da kuka taɓa yi. Lissafin yawanci yana bayyana gaskiya da kansa.

Komawa zuwa Bulog