headers
George Kontostanos | 7 Aug 2012 23:25
Picon

LSI 9240-4i 4K alignment

Hi all,

We have a server with a LSI 9240-4i controller configured in JBOD with
4 SATA disks. Running FreeBSD 9.1-Beta1:

Relevant dmesg:

FreeBSD 9.1-BETA1 #0: Thu Jul 12 09:38:51 UTC 2012
    root <at> farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
CPU: Intel(R) Xeon(R) CPU E31230  <at>  3.20GHz (3200.09-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x206a7  Family = 6  Model = 2a  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x1fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16471670784 (15708 MB)
...
mfi0: <Drake Skinny> port 0xe000-0xe0ff mem
0xf7a60000-0xf7a63fff,0xf7a00000-0xf7a3ffff irq 16 at device 0.0 on
pci1
mfi0: Using MSI
mfi0: Megaraid SAS driver Ver 4.23
...
mfi0: 321 (397672301s/0x0020/info) - Shutdown command received from host
mfi0: 322 (boot + 3s/0x0020/info) - Firmware initialization started
(PCI ID 0073/1000/9241/1000)
mfi0: 323 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664
mfi0: 324 (boot + 3s/0x0020/info) - Firmware initialization started
(Continue reading)

Permalink | Reply |
headers
Jan Mikkelsen | 8 Aug 2012 09:05

Re: LSI 9240-4i 4K alignment

Hi,

Works fine for me with 9.0-p3 with the same controller, slight firmware differences:

mfi0: 2709 (boot + 4s/0x0020/info) - Firmware version 2.120.244-1482
mfi0: 2710 (boot + 5s/0x0020/info) - Package version 20.10.1-0077
mfi0: 2711 (boot + 5s/0x0020/info) - Board Revision 04A

I will be trying out 9.1-BETA on a new batch of machines next week ...

Regards,

Jan.

On 08/08/2012, at 7:25 AM, George Kontostanos <gkontos.mail <at> gmail.com> wrote:

> Hi all,
> 
> We have a server with a LSI 9240-4i controller configured in JBOD with
> 4 SATA disks. Running FreeBSD 9.1-Beta1:
> 
> Relevant dmesg:
> 
> FreeBSD 9.1-BETA1 #0: Thu Jul 12 09:38:51 UTC 2012
>    root <at> farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
> CPU: Intel(R) Xeon(R) CPU E31230  <at>  3.20GHz (3200.09-MHz K8-class CPU)
>  Origin = "GenuineIntel"  Id = 0x206a7  Family = 6  Model = 2a  Stepping = 7
>  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> Features2=0x1fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
>  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
(Continue reading)

Permalink | Reply |
headers
George Kontostanos | 8 Aug 2012 20:18
Picon

Re: LSI 9240-4i 4K alignment

On Wed, Aug 8, 2012 at 10:05 AM, Jan Mikkelsen <janm <at> transactionware.com> wrote:
> Hi,
>
> Works fine for me with 9.0-p3 with the same controller, slight firmware differences:
>
> mfi0: 2709 (boot + 4s/0x0020/info) - Firmware version 2.120.244-1482
> mfi0: 2710 (boot + 5s/0x0020/info) - Package version 20.10.1-0077
> mfi0: 2711 (boot + 5s/0x0020/info) - Board Revision 04A
>
> I will be trying out 9.1-BETA on a new batch of machines next week ...
>
> Regards,
>
> Jan.
>
Hi can you clarify if this was done using gpart and gnop?

Thanks
_______________________________________________
freebsd-stable <at> freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscribe <at> freebsd.org"
Permalink | Reply |
headers
Jan Mikkelsen | 9 Aug 2012 01:01

Re: LSI 9240-4i 4K alignment

Hi,

On 09/08/2012, at 4:18 AM, George Kontostanos <gkontos.mail <at> gmail.com> wrote:

> On Wed, Aug 8, 2012 at 10:05 AM, Jan Mikkelsen <janm <at> transactionware.com> wrote:
>> Hi,
>> 
>> Works fine for me with 9.0-p3 with the same controller, slight firmware differences:
>> 
>> ...
> Hi can you clarify if this was done using gpart and gnop?
> 

gnop on the raw disks. Before doing the gnop, there is a "gpart destroy -F" in the script, and dd'ing a bunch of
zeros. 

Regards,

Jan.

_______________________________________________
freebsd-stable <at> freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscribe <at> freebsd.org"
Permalink | Reply |
headers
George Kontostanos | 16 Aug 2012 11:38
Picon

Re: LSI 9240-4i 4K alignment

After contacting the manufacturer we got this response:

------
My apologies for the wrong information provided in my previous email.
I was under the impression that this OS is still supported but after
checking with our developer,  FreeBSD is currently not supported with
the LSI Megaraid Cards due to some issue with the driver we've
provided. It will be supported in our upcoming releases which may come
by the end of this year.  Please check back on our website during that
time frame for the FreeBSD driver.
Once again please accept my apologies for the inconvenience.
-----

--

-- 
George Kontostanos
Aicom telecoms ltd
http://www.aisecure.net
_______________________________________________
freebsd-stable <at> freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscribe <at> freebsd.org"
Permalink | Reply |
headers
Steven Hartland | 16 Aug 2012 13:11
Picon
Favicon

Re: LSI 9240-4i 4K alignment

----- Original Message ----- 
From: "George Kontostanos" <gkontos.mail <at> gmail.com>
To: "FreeBSD Stable" <freebsd-stable <at> freebsd.org>; <freebsd-hardware <at> freebsd.org>
Sent: Thursday, August 16, 2012 10:38 AM
Subject: Re: LSI 9240-4i 4K alignment

> After contacting the manufacturer we got this response:
> 
> ------
> My apologies for the wrong information provided in my previous email.
> I was under the impression that this OS is still supported but after
> checking with our developer,  FreeBSD is currently not supported with
> the LSI Megaraid Cards due to some issue with the driver we've
> provided. It will be supported in our upcoming releases which may come
> by the end of this year.  Please check back on our website during that
> time frame for the FreeBSD driver.
> Once again please accept my apologies for the inconvenience.
> -----

I would ask them if they have a fix, as if they do there's nothing
stopping you building a custom kernel with the update.

Its quite common for big companies to not "officially" support until a
release but that doesn't mean they don't have a fix if you know what I
mean :)

In addition to this we're running LSI 2008 based controllers here on
8.2-RELEASE + manually merged in mps driver with ZFS just fine. They
aren't running 4k aligned but they are working well.
(Continue reading)

Permalink | Reply |
headers
George Kontostanos | 16 Aug 2012 17:36
Picon

Re: LSI 9240-4i 4K alignment

On Thu, Aug 16, 2012 at 2:11 PM, Steven Hartland
<killing <at> multiplay.co.uk> wrote:
> ----- Original Message ----- From: "George Kontostanos"
> <gkontos.mail <at> gmail.com>
> To: "FreeBSD Stable" <freebsd-stable <at> freebsd.org>;
> <freebsd-hardware <at> freebsd.org>
> Sent: Thursday, August 16, 2012 10:38 AM
> Subject: Re: LSI 9240-4i 4K alignment
>
>
>
>> After contacting the manufacturer we got this response:
>>
>> ------
>> My apologies for the wrong information provided in my previous email.
>> I was under the impression that this OS is still supported but after
>> checking with our developer,  FreeBSD is currently not supported with
>> the LSI Megaraid Cards due to some issue with the driver we've
>> provided. It will be supported in our upcoming releases which may come
>> by the end of this year.  Please check back on our website during that
>> time frame for the FreeBSD driver.
>> Once again please accept my apologies for the inconvenience.
>> -----
>
>
> I would ask them if they have a fix, as if they do there's nothing
> stopping you building a custom kernel with the update.

You are right but it seems more cost effective to get a new controller
that has support under the mps driver.
(Continue reading)

Permalink | Reply |
headers
Steven Hartland | 16 Aug 2012 18:26
Picon
Favicon

Re: LSI 9240-4i 4K alignment

----- Original Message ----- 
From: "George Kontostanos" <gkontos.mail <at> gmail.com>
> 
> I know. The problem with that controller is that for some reason it
> doesn't like gpart. I have gnoped the drives directly and it seems to
> be working so far.

It still really smells like something higher up the layers than the
controller tbh.

>> In addition to this we're running LSI 2008 based controllers here on
>> 8.2-RELEASE + manually merged in mps driver with ZFS just fine. They
>> aren't running 4k aligned but they are working well.
>>
> 
> Right, they fall under the mps driver like the following:
> 
> LSI Logic SAS2004 (4 Port SAS)
> LSI Logic SAS2008 (8 Port SAS)
> LSI Logic SAS2108 (8 Port SAS)
> LSI Logic SAS2116 (16 Port SAS)
> LSI Logic SAS2208 (8 Port SAS)

Confused as your 9240-4i is a SAS2008 based card so you "shouldnt" be
seeing any difference as it should be supported just fine under mps.

The cards we have here are 9211-8i if that helps.

    Regards
    Steve
(Continue reading)

Permalink | Reply |
headers
George Kontostanos | 16 Aug 2012 19:53
Picon

Re: LSI 9240-4i 4K alignment

On Thu, Aug 16, 2012 at 7:26 PM, Steven Hartland
<killing <at> multiplay.co.uk> wrote:
> ----- Original Message ----- From: "George Kontostanos"
> <gkontos.mail <at> gmail.com>
>>
>>
>> I know. The problem with that controller is that for some reason it
>> doesn't like gpart. I have gnoped the drives directly and it seems to
>> be working so far.
>

> It still really smells like something higher up the layers than the
> controller tbh.

We have tried many combinations with different drives. Any other suggestions?

>
>>> In addition to this we're running LSI 2008 based controllers here on
>>> 8.2-RELEASE + manually merged in mps driver with ZFS just fine. They
>>> aren't running 4k aligned but they are working well.
>>>
>>
>> Right, they fall under the mps driver like the following:
>>
>> LSI Logic SAS2004 (4 Port SAS)
>> LSI Logic SAS2008 (8 Port SAS)
>> LSI Logic SAS2108 (8 Port SAS)
>> LSI Logic SAS2116 (16 Port SAS)
>> LSI Logic SAS2208 (8 Port SAS)
>
(Continue reading)

Permalink | Reply |
headers
Steven Hartland | 16 Aug 2012 20:45
Picon
Favicon

Re: LSI 9240-4i 4K alignment

----- Original Message ----- 
From: "George Kontostanos" gkontos.mail <at> gmail.com

>> It still really smells like something higher up the layers than the
>> controller tbh.
> 
> We have tried many combinations with different drives. Any other suggestions?

See below

>> Confused as your 9240-4i is a SAS2008 based card so you "shouldnt" be
>> seeing any difference as it should be supported just fine under mps.
>>
>> The cards we have here are 9211-8i if that helps.
> 
> You are right, the chip specs say: LSISAS2108 RAID-on-Chip

Hmm LSI's website says its a LSISAS2008 not a LSISAS2108 
http://www.lsi.com/channel/products/storagecomponents/Pages/MegaRAIDSAS9240-4i.aspx

> The drives are identified as mfisyspd0, mfisyspd1, etc.

Are you actually using HW RAID volumns then instead of direct disks?

If so I would advice configuring the disks as passthrough.

What does pciconf -lv say?

On boot I see the following here to 2008 chip controller:-
(Continue reading)

Permalink | Reply |
headers
Steven Hartland | 16 Aug 2012 20:51
Picon
Favicon

Re: LSI 9240-4i 4K alignment

----- Original Message ----- 
From: "George Kontostanos" <gkontos.mail <at> gmail.com>

> You are right, the chip specs say: LSISAS2108 RAID-on-Chip
> 
> The drives are identified as mfisyspd0, mfisyspd1, etc.

The following might be interesting to you:-
http://forums.servethehome.com/showthread.php?599-LSI-RAID-Controller-and-HBA-Complete-Listing-Plus-OEM-Models

Which states:-
LSI MegaRAID SAS 9240-4i 1x4 port internal SAS vertical,
no cache, no BBU, RAID 0, 1, 10 and 5, can be crossflashed
to LSI9211 IT/IR

This is insteresting as this is the card we're using but
in the 8 port version under mps :)

So based on that a simple firmware flash may be all you
need.

    Regards
    Steve

================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is
addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or
otherwise disseminating it or any information contained in it. 

In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
(Continue reading)

Permalink | Reply |
headers
George Kontostanos | 16 Aug 2012 23:59
Picon

Re: LSI 9240-4i 4K alignment

On Thu, Aug 16, 2012 at 9:51 PM, Steven Hartland
<killing <at> multiplay.co.uk> wrote:
> ----- Original Message ----- From: "George Kontostanos"
> <gkontos.mail <at> gmail.com>
>
>> You are right, the chip specs say: LSISAS2108 RAID-on-Chip
>>
>> The drives are identified as mfisyspd0, mfisyspd1, etc.
>
>
> The following might be interesting to you:-
> http://forums.servethehome.com/showthread.php?599-LSI-RAID-Controller-and-HBA-Complete-Listing-Plus-OEM-Models
>
> Which states:-
> LSI MegaRAID SAS 9240-4i 1x4 port internal SAS vertical,
> no cache, no BBU, RAID 0, 1, 10 and 5, can be crossflashed
> to LSI9211 IT/IR
>
> This is insteresting as this is the card we're using but
> in the 8 port version under mps :)
>
> So based on that a simple firmware flash may be all you
> need.
>
>
>    Regards
>    Steve
>
> ================================================
> This e.mail is private and confidential between Multiplay (UK) Ltd. and the
(Continue reading)

Permalink | Reply |
headers
Don Lewis | 19 Aug 2012 19:37
Picon
Favicon

Re: LSI 9240-4i 4K alignment

On 16 Aug, Steven Hartland wrote:
> ----- Original Message ----- 
> From: "George Kontostanos" <gkontos.mail <at> gmail.com>
>  
>> You are right, the chip specs say: LSISAS2108 RAID-on-Chip
>> 
>> The drives are identified as mfisyspd0, mfisyspd1, etc.
> 
> The following might be interesting to you:-
> http://forums.servethehome.com/showthread.php?599-LSI-RAID-Controller-and-HBA-Complete-Listing-Plus-OEM-Models
> 
> Which states:-
> LSI MegaRAID SAS 9240-4i 1x4 port internal SAS vertical,
> no cache, no BBU, RAID 0, 1, 10 and 5, can be crossflashed
> to LSI9211 IT/IR
> 
> This is insteresting as this is the card we're using but
> in the 8 port version under mps :)

I wish I would have known this earlier.  I just put together a ZFS
server using LSI MegaRAID SAS 9240-8i cards.  The cabling probably would
have been cleaner with the 9211-8i, but I went with the 9240 because the
vendor that I purchased the cards from listed that 9240 as being
PCI-Express 2.0, but didn't say that about the 9211.  I also got the
impression that the 9240 recognized JBOD drives with the off-the-shelf
firmware, whereas the 9211 did not.

Even LSI's own site is a bit confusing.  They list the 9211 in the HBA
section, but its specs don't mention JBOD, whereas the 9240 is listed in
the RAID section and its specs do list JBOD.  If the only physical
(Continue reading)

Permalink | Reply |
headers
Steven Hartland | 19 Aug 2012 23:04
Picon
Favicon

Re: LSI 9240-4i 4K alignment


----- Original Message ----- 
From: "Don Lewis" <truckman <at> FreeBSD.org>
To: <killing <at> multiplay.co.uk>
Cc: <gkontos.mail <at> gmail.com>; <freebsd-stable <at> FreeBSD.org>; <freebsd-hardware <at> FreeBSD.org>
Sent: Sunday, August 19, 2012 6:37 PM
Subject: Re: LSI 9240-4i 4K alignment

> On 16 Aug, Steven Hartland wrote:
>> ----- Original Message ----- 
>> From: "George Kontostanos" <gkontos.mail <at> gmail.com>
>>  
>>> You are right, the chip specs say: LSISAS2108 RAID-on-Chip
>>> 
>>> The drives are identified as mfisyspd0, mfisyspd1, etc.
>> 
>> The following might be interesting to you:-
>> http://forums.servethehome.com/showthread.php?599-LSI-RAID-Controller-and-HBA-Complete-Listing-Plus-OEM-Models
>> 
>> Which states:-
>> LSI MegaRAID SAS 9240-4i 1x4 port internal SAS vertical,
>> no cache, no BBU, RAID 0, 1, 10 and 5, can be crossflashed
>> to LSI9211 IT/IR
>> 
>> This is insteresting as this is the card we're using but
>> in the 8 port version under mps :)
> 
> I wish I would have known this earlier.  I just put together a ZFS
> server using LSI MegaRAID SAS 9240-8i cards.  The cabling probably would
> have been cleaner with the 9211-8i, but I went with the 9240 because the
(Continue reading)

Permalink | Reply |
headers
Josh Paetzel | 20 Aug 2012 04:34
Favicon

Re: LSI 9240-4i 4K alignment

On 08/19/2012 14:04, Steven Hartland wrote:
> 
> ----- Original Message ----- From: "Don Lewis" <truckman <at> FreeBSD.org>
> To: <killing <at> multiplay.co.uk>
> Cc: <gkontos.mail <at> gmail.com>; <freebsd-stable <at> FreeBSD.org>;
> <freebsd-hardware <at> FreeBSD.org>
> Sent: Sunday, August 19, 2012 6:37 PM
> Subject: Re: LSI 9240-4i 4K alignment
> 
> 
>> On 16 Aug, Steven Hartland wrote:
>>> ----- Original Message ----- From: "George Kontostanos"
>>> <gkontos.mail <at> gmail.com>
>>>  
>>>> You are right, the chip specs say: LSISAS2108 RAID-on-Chip
>>>>
>>>> The drives are identified as mfisyspd0, mfisyspd1, etc.
>>>
>>> The following might be interesting to you:-
>>> http://forums.servethehome.com/showthread.php?599-LSI-RAID-Controller-and-HBA-Complete-Listing-Plus-OEM-Models
>>>
>>>
>>> Which states:-
>>> LSI MegaRAID SAS 9240-4i 1x4 port internal SAS vertical,
>>> no cache, no BBU, RAID 0, 1, 10 and 5, can be crossflashed
>>> to LSI9211 IT/IR
>>>
>>> This is insteresting as this is the card we're using but
>>> in the 8 port version under mps :)
>>
(Continue reading)

Permalink | Reply |
headers
Don Lewis | 20 Aug 2012 09:19
Picon
Favicon

Re: LSI 9240-4i 4K alignment

On 19 Aug, Josh Paetzel wrote:
> On 08/19/2012 14:04, Steven Hartland wrote:

>> HBA's are the way to go if your using ZFS to manage the disks, you only
>> need RAID if your using a FS which doesn't manage the disk side well
>> such as UFS.
>> 
>> Its often quite common for RAID controllers to actually be slower
>> vs RAID controllers as the RAID stack can get in the way.

Any idea of what kind of performance penalty I might see by using the
RAID firmware in JBOD mode vs flashing the IT firmware?

> Just to clear up,
> 
> The 9240 is a sas2008 based card with the megaraid software on top of
> it.  In it's default config from LSI the FreeBSD mfi will recognize it
> in later versions of FreeBSD (The upcoming 9.1  for sure)  Older
> versions of mfi will not recognize it.
> 
> The card can be flashed with IT firmware and then becomes a 9211 HBA,
> but it's a bit more expensive than a 9211 is so that doesn't make sense
> to do in many cases.

The price difference was pretty minor when I looked.  Confusingly
enough, the 9211 HBA also has some RAID capabilities.

For me, the biggest advantage of the 9211 would be that it would have
allowed me to use shorter cables.
(Continue reading)

Permalink | Reply |
headers
Josh Paetzel | 20 Aug 2012 16:25
Favicon

Re: LSI 9240-4i 4K alignment

On 08/20/2012 00:19, Don Lewis wrote:
> On 19 Aug, Josh Paetzel wrote:
>> On 08/19/2012 14:04, Steven Hartland wrote:
> 
>>> HBA's are the way to go if your using ZFS to manage the disks, you only
>>> need RAID if your using a FS which doesn't manage the disk side well
>>> such as UFS.
>>>
>>> Its often quite common for RAID controllers to actually be slower
>>> vs RAID controllers as the RAID stack can get in the way.
> 
> Any idea of what kind of performance penalty I might see by using the
> RAID firmware in JBOD mode vs flashing the IT firmware?
> 

I don't have any current numbers, on ZFS v14 14 RAID controllers were
actually a bit faster, but that's all changed dramatically.  On our high
end stuff we can get HBAs to go over 25% faster than high end RAID
controllers, like the 9260/9280, but we don't test with RAID controllers
anymore at all, so I don't have up to the minute info.

ZFS does block checksums, and so do LSI mfi cards, even when in "JBOD"
mode, you also can't bypass the cache on the card without a huge
performance hit, so you end up with 256MB or whatever in between your
disks and the OS.  In addition because the 9240 is based on the 2008
which lacks hardware assist for RAID5/6 those two modes are done in
software, so you take another hit there.

Advantages: ZFS doesn't work with hot spares as of this moment on
FreeBSD, but LSI controllers do, so if your strategy involves hot spares
(Continue reading)

Permalink | Reply |
headers
Andrew Leonard | 20 Aug 2012 21:51

Re: LSI 9240-4i 4K alignment

On Sun, Aug 19, 2012 at 7:34 PM, Josh Paetzel <josh <at> tcbug.org> wrote:

> On the dmesg posted the firmware on the card is phase 11.  This *must*
> be in lockstep with the driver version or the card may not play nicely.
>  FreeBSD 8.3 and 9.0 have v13 of the driver, the upcoming 9.1 will have
> v14.  Note that v14 fixes a *ton* of stability bugs, including issues
> where bad drives would hang the controller or prevent systems from booting.

Oof, good to know.  I happen to have a server with v9 9211 firmware
and v13 mps drivers that's having stability problems under load; it
will be interesting to see if updating the firmware solves the
problem.  Is there someplace I should have been checking to know that
this was a requirement?

Thanks,
Andy
_______________________________________________
freebsd-stable <at> freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscribe <at> freebsd.org"
Permalink | Reply |
headers
Michael Fuckner | 16 Aug 2012 19:14

Re: LSI 9240-4i 4K alignment


>
> Right, they fall under the mps driver like the following:
>
> LSI Logic SAS2004 (4 Port SAS)
> LSI Logic SAS2008 (8 Port SAS)
they are used with mps driver

> LSI Logic SAS2108 (8 Port SAS)
> LSI Logic SAS2116 (16 Port SAS)
> LSI Logic SAS2208 (8 Port SAS)
LSI2308

those cards are all used with mfi.

The 9240 is special. It uses the 2008-Chip and a Megaraid-Firmware (but 
no Cache and also no BBU).

Regards,
  Michael!
_______________________________________________
freebsd-hardware <at> freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hardware
To unsubscribe, send any mail to "freebsd-hardware-unsubscribe <at> freebsd.org"
Permalink | Reply |
headers
George Kontostanos | 8 Aug 2012 12:28
Picon

LSI 9240-4i 4K alignment

Hi all,

We have a server with a LSI 9240-4i controller configured in JBOD with
4 SATA disks. Running FreeBSD 9.1-Beta1:

Relevant dmesg:

FreeBSD 9.1-BETA1 #0: Thu Jul 12 09:38:51 UTC 2012
    root <at> farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
CPU: Intel(R) Xeon(R) CPU E31230  <at>  3.20GHz (3200.09-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x206a7  Family = 6  Model = 2a  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x1fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16471670784 (15708 MB)
...
mfi0: <Drake Skinny> port 0xe000-0xe0ff mem
0xf7a60000-0xf7a63fff,0xf7a00000-0xf7a3ffff irq 16 at device 0.0 on
pci1
mfi0: Using MSI
mfi0: Megaraid SAS driver Ver 4.23
...
mfi0: 321 (397672301s/0x0020/info) - Shutdown command received from host
mfi0: 322 (boot + 3s/0x0020/info) - Firmware initialization started
(PCI ID 0073/1000/9241/1000)
mfi0: 323 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664
mfi0: 324 (boot + 3s/0x0020/info) - Firmware initialization started
(Continue reading)

Permalink | Reply |
headers
Don Lewis | 19 Aug 2012 19:58
Picon
Favicon

Re: LSI 9240-4i 4K alignment

On  8 Aug, George Kontostanos wrote:
> Hi all,
> 
> We have a server with a LSI 9240-4i controller configured in JBOD with
> 4 SATA disks. Running FreeBSD 9.1-Beta1:
> 
> Relevant dmesg:
> 
> FreeBSD 9.1-BETA1 #0: Thu Jul 12 09:38:51 UTC 2012
>     root <at> farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
> CPU: Intel(R) Xeon(R) CPU E31230  <at>  3.20GHz (3200.09-MHz K8-class CPU)
>   Origin = "GenuineIntel"  Id = 0x206a7  Family = 6  Model = 2a  Stepping = 7
>   Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> Features2=0x1fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
>   AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
>   AMD Features2=0x1<LAHF>
>   TSC: P-state invariant, performance statistics
> real memory  = 17179869184 (16384 MB)
> avail memory = 16471670784 (15708 MB)
> ...
> mfi0: <Drake Skinny> port 0xe000-0xe0ff mem
> 0xf7a60000-0xf7a63fff,0xf7a00000-0xf7a3ffff irq 16 at device 0.0 on
> pci1
> mfi0: Using MSI
> mfi0: Megaraid SAS driver Ver 4.23
> ...
> mfi0: 321 (397672301s/0x0020/info) - Shutdown command received from host
> mfi0: 322 (boot + 3s/0x0020/info) - Firmware initialization started
> (PCI ID 0073/1000/9241/1000)
> mfi0: 323 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664
(Continue reading)

Permalink | Reply |
headers
George Kontostanos | 19 Aug 2012 20:07
Picon

Re: LSI 9240-4i 4K alignment

On Sun, Aug 19, 2012 at 8:58 PM, Don Lewis <truckman <at> freebsd.org> wrote:
> On  8 Aug, George Kontostanos wrote:
>> Hi all,
>>
>> We have a server with a LSI 9240-4i controller configured in JBOD with
>> 4 SATA disks. Running FreeBSD 9.1-Beta1:
>>
>> Relevant dmesg:
>>
>> FreeBSD 9.1-BETA1 #0: Thu Jul 12 09:38:51 UTC 2012
>>     root <at> farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
>> CPU: Intel(R) Xeon(R) CPU E31230  <at>  3.20GHz (3200.09-MHz K8-class CPU)
>>   Origin = "GenuineIntel"  Id = 0x206a7  Family = 6  Model = 2a  Stepping = 7
>>   Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>> Features2=0x1fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX>
>>   AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
>>   AMD Features2=0x1<LAHF>
>>   TSC: P-state invariant, performance statistics
>> real memory  = 17179869184 (16384 MB)
>> avail memory = 16471670784 (15708 MB)
>> ...
>> mfi0: <Drake Skinny> port 0xe000-0xe0ff mem
>> 0xf7a60000-0xf7a63fff,0xf7a00000-0xf7a3ffff irq 16 at device 0.0 on
>> pci1
>> mfi0: Using MSI
>> mfi0: Megaraid SAS driver Ver 4.23
>> ...
>> mfi0: 321 (397672301s/0x0020/info) - Shutdown command received from host
>> mfi0: 322 (boot + 3s/0x0020/info) - Firmware initialization started
>> (PCI ID 0073/1000/9241/1000)
(Continue reading)

Permalink | Reply |
headers
Don Lewis | 25 Aug 2012 09:17
Picon
Favicon

Re: LSI 9240-4i 4K alignment

On  8 Aug, George Kontostanos wrote:

> The problem:
> 
> When trying to create a RaidZ pool using gpart and perform a 4K
> alignment using  gnop, we get the follwoing error immediately after
> exporting the pool and destroying the .nop devices:
> 
> id: 8043746387654554958
>   state: FAULTED
>  status: One or more devices contains corrupted data.
>  action: The pool cannot be imported due to damaged devices or data.
> 	The pool may be active on another system, but can be imported using
> 	the '-f' flag.
>    see: http://illumos.org/msg/ZFS-8000-5E
>  config:
> 
> 	Pool                      FAULTED  corrupted data
> 	  raidz1-0                ONLINE
> 	    13283347160590042564  UNAVAIL  corrupted data
> 	    16981727992215676534  UNAVAIL  corrupted data
> 	    6607570030658834339   UNAVAIL  corrupted data
> 	    3435463242860701988   UNAVAIL  corrupted data
> 
> When we use glabel for the same purpose with the combination of gnop,
> the pool imports fine.

Might kern/170945 have something to do with this?

_______________________________________________
(Continue reading)

Permalink | Reply |

Gmane